-- Logs begin at Thu 2022-06-02 12:26:08 UTC, end at Thu 2022-06-02 13:47:06 UTC. -- Jun 02 13:00:23.790681 dv-cinder-797608-26-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 13:00:23.797992 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:00:23 2022] *** Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: nodename: dv-cinder-797608-26-iscsi Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: machine: x86_64 Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: clock source: unix Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: pcre jit disabled Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: detected number of CPU cores: 4 Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: current working directory: / Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: your processes number limit is 47680 Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: your memory page size is 4096 bytes Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: detected max file descriptor number: 2048 Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: lock engine: pthread robust mutexes Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: thunder lock: enabled Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 13:00:23.802183 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:00:23.852456 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: Python main interpreter initialized at 0x558853ef79c0 Jun 02 13:00:23.852456 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: python threads support enabled Jun 02 13:00:23.852456 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: your server socket listen backlog is limited to 100 connections Jun 02 13:00:23.852456 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:00:23.852846 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:00:23.852914 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: *** Operational MODE: preforking *** Jun 02 13:00:23.853177 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:00:23.853177 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: spawned uWSGI master process (pid: 80571) Jun 02 13:00:23.853395 dv-cinder-797608-26-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 02 13:00:23.854251 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: spawned uWSGI worker 1 (pid: 80583, cores: 1) Jun 02 13:00:23.854342 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: spawned uWSGI worker 2 (pid: 80584, cores: 1) Jun 02 13:00:23.861192 dv-cinder-797608-26-iscsi devstack@keystone.service[80571]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:00:29.587638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:00:29.587638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: from cryptography.utils import int_from_bytes Jun 02 13:00:29.588486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:00:29.588486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: from cryptography.utils import int_from_bytes Jun 02 13:00:29.588943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:00:29.588943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: from cryptography.utils import int_from_bytes Jun 02 13:00:29.589089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:00:29.589089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: from cryptography.utils import int_from_bytes Jun 02 13:00:29.638547 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:00:29.638722 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:00:29.638802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:00:29.638898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:00:29.638967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] command line args: [] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:00:29.639033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] command line args: [] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:00:29.639178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:00:29.639266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:00:29.639350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ================================================================================ {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:00:29.639428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ================================================================================ {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:00:29.639593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] admin_token = **** {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.639680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] admin_token = **** {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.639831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] config_dir = [] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.639938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] config_dir = [] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.640027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.640107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.640209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] config_source = [] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.640289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] config_source = [] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.640388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] debug = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.640472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] debug = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.640589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.640845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.640985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.641100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.641212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.641316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.641414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.641508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.641609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.641705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.641817 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] list_limit = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.641916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] list_limit = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.642010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] log_config_append = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.642615 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] log_config_append = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.642732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.642835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.642835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] log_dir = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.643045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] log_dir = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.643155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] log_file = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.643252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] log_file = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.643355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.643439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.643565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.643641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.643757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.643837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.643990 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.644077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.644209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.644293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.644293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.644487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.644613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.644698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.644821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.644904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.645020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.645095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.645215 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.645357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.645440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.645558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.645632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.645760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.645914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.646018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.646098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.646215 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.646373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.646502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.646859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.646940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.647064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] publish_errors = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.647151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] publish_errors = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.647267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.647349 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.647464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.647545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.647667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.647751 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.647908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.648012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.648086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.648282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.648360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] standard_threads = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.648483 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] standard_threads = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.648559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.648676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.648750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.648829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.648952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] use_journal = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] use_journal = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] use_json = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] use_json = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] use_stderr = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] use_stderr = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] use_syslog = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649656 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] use_syslog = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.649855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:00:29.650029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.650125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.650268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.650403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.650547 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.650649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.650749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.650905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.650987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.651065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.651220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.651323 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.651457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.651604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.651683 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.651786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.651963 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.652049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.652209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.652290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.652421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.652579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.652681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.652788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.652928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.653001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.653094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.653226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.653333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.653570 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.653721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.653873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.653950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.654051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.654197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.654281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.654351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.654521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.654609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.654740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.654880 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.654990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.655075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.655231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.655327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.655510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.655604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.655891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.655970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.656050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.656204 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.656285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.656415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.656561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.656634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.656722 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.656864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.656949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.657114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.657252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.657323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.657423 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.657570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.657634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.658373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.658561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.658628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.658708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.658914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.659015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.659122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.659263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.659400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.659556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.659663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.659777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.659952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.660036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.660201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.660285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.660391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.660543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.660639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.660709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.660810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.660966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.661051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.661203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.661307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.661379 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.661519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.661631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.661719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.661860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.661954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.662998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.663175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.663265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.663379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.663547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.663642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.663724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.663860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.664003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.664085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.664233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.664307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.664383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.664550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.664653 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.664736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.664877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.664961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.665040 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.665196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.665354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.665490 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.665580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.665659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.665754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.665893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.665991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.666074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.666218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.666334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.666479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.666564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.666712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.666878 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.666956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.667047 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.667207 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.667287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.667357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.667508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.667594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.667690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.667849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.667948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.668096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.668228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.668331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.668469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.668569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.668654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.668847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.668940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.669033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.669182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.669263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.669366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.669516 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.669593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.669721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.669857 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.669957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.670048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.670194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.670288 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.670473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.670563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.670668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.670828 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.670911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.670987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.671155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.671236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.671354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.671515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.671595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.671695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.671833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.671957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.672066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.672218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.672293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.672402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.672525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.672597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.672744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.672887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.672961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.673075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.673211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.673302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.673470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.673590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.673706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.673854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.673951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.674025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.674181 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.674287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.674443 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.674533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.674680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.674834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] auth.external = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.674928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.675011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] auth.external = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.675166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.675268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.675392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.675523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.675623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] auth.password = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.675719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.675858 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] auth.token = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.675975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] auth.password = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.676145 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.676237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] auth.token = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.676341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.676481 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.676557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.676638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.676843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.676954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.677044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.677183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.677257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.677328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.677486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.677562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.677767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] credential.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.677858 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.677961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] credential.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.678118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.678201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.678273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.678478 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.678599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.678682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.678907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.678987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.679148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.679244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.679318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.679466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.679557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.679638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.679808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.679955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.680097 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.680191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.680273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.680361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.680505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.680579 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.680638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.680841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.680926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.681097 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.681188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.681334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.681467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.681550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] federation.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.681621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.681831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.681949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] federation.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.682088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.682178 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.682260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.682347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.682488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.682563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.682742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.682840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.682948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.683100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.683193 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.683266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.683460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.683570 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.683662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.683806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.683920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.684014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.684150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.684225 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.684408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.684499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.684615 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.684777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.684860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.684926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.685086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.685168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.685299 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.685458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.685554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.685630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.685789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.685895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.685976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.686126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.686222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.686300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.686455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.686552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.686681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.686813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.686892 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.686954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.687126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.687223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.687400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.687491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.687588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.687754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.687946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.688048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.688305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.688430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.688543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.688720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.688720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.688951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.688951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.689093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.689209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.689317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.689398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.689503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.689577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.689647 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.689773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.689870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.690005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.690128 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.690240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.690342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.690476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.690572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.690721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.690825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.690948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.691047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.691190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.691313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.691438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.691553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.691696 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.691785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.691910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.692004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.692162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.692265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.692396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.692502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.692627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.692742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.692856 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.692924 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.693078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.693181 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.693314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.693429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.693533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.693622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.693797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.693896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.694014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.694102 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.694257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.694345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.694504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.694631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.694712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.694781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.694947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.695035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.695188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.695303 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.695426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.695543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.695696 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.695791 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.695932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.696035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.696139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.696282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.696374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.696435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.696594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.696682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.696834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.696975 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.697215 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.697328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.697459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.697565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.697702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.697803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.697954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.698056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.698187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.698273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.698420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.698544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.698646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.698776 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.698883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.698982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.699099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.699214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.699314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.699389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.699562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.699652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.699809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.699936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.700078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.700183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.700353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.700442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.700572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.700758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.700841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.700994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.701080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.701238 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.701344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.701503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.701579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.701708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.701822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.701962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.702065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.702201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.702297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.702443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.702551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.702693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.702778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.702925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.703037 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.703183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.703274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.703413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.703517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.703660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.703748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.703927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.704038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.704153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.704247 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.704516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.705139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.705564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.705647 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.705709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.705810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.705901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.705962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.706020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.706098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.706222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] resource.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.706312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] resource.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.706389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.706472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.706563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.706624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.706756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.706927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.707041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.707172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.707305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.707401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.707518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.707658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.707785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.707949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.708075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.708201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.708327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.708452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.708581 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] role.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.708699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] role.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.708833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] role.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.708932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] role.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.709022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.709127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.709226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.709333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.709438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.709549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.709679 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.709805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.709924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.710048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.710151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.710279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.710398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.710541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.710695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.710805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.710984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.711113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.711196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.711306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.711422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.711507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.711599 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.711699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.711828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.711957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.712084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.712209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.712331 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.712448 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.712559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.712693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.712808 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.712909 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.713031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.713140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.713253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.713333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.713437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.713544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.713683 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.713826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.713978 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.714067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.714172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.714272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.714402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.714512 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.714637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.714732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.714865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.714965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.715096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.715189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.715345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.715463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.715597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.715669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.716017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.716162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.716311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.716437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.716555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.716663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.716772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.716884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.717019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] token.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.717131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] token.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.717244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.717366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.717473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.717593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.717729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.717839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.717964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.718085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.718204 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.718324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.718443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.718563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.718686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.718791 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.718917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.719032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.719166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.719291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.719415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.719530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.719645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.719760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.719916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.720044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.720170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.720348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.720994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.721126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.721261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.721331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.721438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.721520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.721630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.721732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.721732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.connection = **** {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.721922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.connection = **** {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.722046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.722277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.722364 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.722475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.722555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.722677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.722779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.722863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.722926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.722985 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.723054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.723140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.723202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.723359 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.723478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.723563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.723637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.723765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.723902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.724024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.724136 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.724293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.724428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.724541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.724607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.724717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.724818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.724949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.725038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.725192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.725274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.725424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.725522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.725659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.725771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.725880 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:00:29.725970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:00:29.726068 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:00:29.755526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.755715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.755837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.755947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.756033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.756119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.764542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.764677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.793982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.794199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.794312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.794440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.849606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.849859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.899958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.900131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.900418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.900653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.968529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.968738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.968828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.968954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.969038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.969166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.969256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.969381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.969466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.969595 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.969678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.969809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.992810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.992948 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.993043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.993126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.993272 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.993381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.993496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.993580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.993739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.993822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.993955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.994038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.994167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:29.994249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.006428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.006538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.019761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.019965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.020039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.020114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.020219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.020322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.020464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.020553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.020656 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.020739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.020868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.020952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.021080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.021163 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:00:30.038408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.038617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.038726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:00:30.038832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:00:30.038950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.039148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:00:30.039230 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.039354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:00:30.039438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.039627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.039710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.039910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.039994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.040168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.040249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.040419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.051188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.051459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.051552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.051723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.051805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.052025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.052116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.052338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.060139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.060492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.063410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.063684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.063792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.064505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.064628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.064831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.064914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.065111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.065205 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.065447 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.065527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.065732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.065818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.066004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.066092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.066270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.066350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.066537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.066617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.066799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.066881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.067109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.093670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.094069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.095484 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.095761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.095842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.096118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.101044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.101319 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.101403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.101594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.101676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.101936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.108871 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.109151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.109235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.109510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.113687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.114058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.114157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.114377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.114460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.114663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.114745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.114938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.115024 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.115212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.115295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.115478 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.115562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.115745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.115827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.116067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.135432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.135592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.135692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.135901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.140403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.140573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.144622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.144830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.144940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.145129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.150041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.150191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.153756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.153871 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.159067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.159174 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.159367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.159453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.159651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.159744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.159958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.160054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.160241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.160334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.160519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.160652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.179520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.179655 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.179802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.179915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.180093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.180186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.180366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.180460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.188378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.188484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.190671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.190769 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.190941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.191029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.194009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.194108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.194291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.194438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.194556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.194670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.194833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.194989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.195117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.195223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.209183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.209286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.209461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.209559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.209738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.209823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.210018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.210142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.210305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.210447 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.210561 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.210669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.210813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.210942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.229115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.229286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.232409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.232665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.235718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.236037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.237380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.237649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.239034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.239293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.239394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.239568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.239660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.239845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.247298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.247630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.248964 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.249347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.252738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.253026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.253162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.253317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.253443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.253591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.253678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.253896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.262692 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.262954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.263050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.263236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.263329 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.263618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.272040 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.272185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:00:30.272315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.272444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.272582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.272710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.272835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.272960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.273084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.273223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.273357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.273485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.273611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.273736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.273892 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.274029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.274155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.274282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.274407 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.274558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.274708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.274835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.274960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.275094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.275220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.275353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.275478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.275606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:00:30.313244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558853ef79c0 pid: 80584 (default app) Jun 02 13:00:30.313460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558853ef79c0 pid: 80583 (default app) Jun 02 13:00:30.317164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b196-1f04-4e4c-9324-71173fe6651e None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:30.317464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b196-1f04-4e4c-9324-71173fe6651e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:30.317741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b196-1f04-4e4c-9324-71173fe6651e None None] PATH_INFO: `/v3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:30.322054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Thu Jun 2 13:00:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:39.348267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7d1bd-f64f-4ace-853b-c0b0fa9a905f None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:39.348845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7d1bd-f64f-4ace-853b-c0b0fa9a905f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:39.348845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7d1bd-f64f-4ace-853b-c0b0fa9a905f None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:39.353212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:00:39.358411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:39.358847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:39.358967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:39.428435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: INFO dbcounter [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] Registered counter for database keystone Jun 02 13:00:39.449207 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG oslo_db.sqlalchemy.engines [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:00:39.455813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writer thread running {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:00:39.734633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG passlib.handlers.bcrypt [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80584) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 13:00:39.734967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG passlib.handlers.bcrypt [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80584) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 13:00:39.790537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:39.792154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:39.918028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 561 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 13:00:40.040549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7d1bd-f64f-4ace-853b-c0b0fa9a905f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:40.111190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: INFO dbcounter [None req-8ac7d1bd-f64f-4ace-853b-c0b0fa9a905f None None] Registered counter for database keystone Jun 02 13:00:40.130770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG oslo_db.sqlalchemy.engines [None req-8ac7d1bd-f64f-4ace-853b-c0b0fa9a905f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:00:40.136960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writer thread running {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:00:40.360420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7d1bd-f64f-4ace-853b-c0b0fa9a905f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:40.364987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c238ad-2f86-4cbe-ad12-ca4127ee3f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:40.365664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c238ad-2f86-4cbe-ad12-ca4127ee3f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:40.365949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c238ad-2f86-4cbe-ad12-ca4127ee3f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:40.366230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c238ad-2f86-4cbe-ad12-ca4127ee3f4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:40.374738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c238ad-2f86-4cbe-ad12-ca4127ee3f4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:40.427428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: WARNING keystone.common.rbac_enforcer.enforcer [None req-49c238ad-2f86-4cbe-ad12-ca4127ee3f4a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 13:00:40.427778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c238ad-2f86-4cbe-ad12-ca4127ee3f4a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:40.438008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Thu Jun 2 13:00:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:00:40.444654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:40.459748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb0d5a-977f-408e-9056-00407de68ef4 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:40.464213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba40b5-b5e2-46fb-bbc1-9a8fd8dfb9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:40.465344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba40b5-b5e2-46fb-bbc1-9a8fd8dfb9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:40.465639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba40b5-b5e2-46fb-bbc1-9a8fd8dfb9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:40.465928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba40b5-b5e2-46fb-bbc1-9a8fd8dfb9b7 admin admin] PATH_INFO: `/v3/projects/4046aee9673645e2803f9186d9e29f17` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:40.467433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba40b5-b5e2-46fb-bbc1-9a8fd8dfb9b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=4046aee9673645e2803f9186d9e29f17)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:40.519606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0eba40b5-b5e2-46fb-bbc1-9a8fd8dfb9b7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 13:00:40.519985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba40b5-b5e2-46fb-bbc1-9a8fd8dfb9b7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:40.524853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Thu Jun 2 13:00:40 2022] GET /identity/v3/projects/4046aee9673645e2803f9186d9e29f17 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:00:42.756951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63149-ad47-4769-9f9e-48fec0161612 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:42.757450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63149-ad47-4769-9f9e-48fec0161612 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:42.757450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63149-ad47-4769-9f9e-48fec0161612 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:42.761580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:00:42.767773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847cf78-b8ab-410b-b723-145774a6afc9 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:42.768216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847cf78-b8ab-410b-b723-145774a6afc9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:42.768449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847cf78-b8ab-410b-b723-145774a6afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:42.787590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0847cf78-b8ab-410b-b723-145774a6afc9 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:42.789202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0847cf78-b8ab-410b-b723-145774a6afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:42.797204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 13:00:42.820585 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea63149-ad47-4769-9f9e-48fec0161612 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:42.833526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea63149-ad47-4769-9f9e-48fec0161612 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:42.837716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33920269-3937-4d90-aea2-e57eeba3c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:42.838355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920269-3937-4d90-aea2-e57eeba3c31e admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:42.838643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920269-3937-4d90-aea2-e57eeba3c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:42.838924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920269-3937-4d90-aea2-e57eeba3c31e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:42.846525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33920269-3937-4d90-aea2-e57eeba3c31e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:42.848334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33920269-3937-4d90-aea2-e57eeba3c31e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:42.856924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Thu Jun 2 13:00:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:00:42.862371 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847cf78-b8ab-410b-b723-145774a6afc9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:42.871677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847cf78-b8ab-410b-b723-145774a6afc9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:42.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17071d-2eaf-4edb-a9ba-8b5a66785dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:42.877501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17071d-2eaf-4edb-a9ba-8b5a66785dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:42.877791 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17071d-2eaf-4edb-a9ba-8b5a66785dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:42.878072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17071d-2eaf-4edb-a9ba-8b5a66785dcf admin admin] PATH_INFO: `/v3/users/ac80ec2c07774b5581b987e15cf3a2d3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:42.879467 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17071d-2eaf-4edb-a9ba-8b5a66785dcf admin admin] RBAC: Authorizing `identity:get_user(user_id=ac80ec2c07774b5581b987e15cf3a2d3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:42.881347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17071d-2eaf-4edb-a9ba-8b5a66785dcf admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:42.882923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Thu Jun 2 13:00:42 2022] GET /identity/v3/users/ac80ec2c07774b5581b987e15cf3a2d3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:45.200745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fa7be-d2e7-4969-8423-96fa7c3f4ea5 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:45.201292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fa7be-d2e7-4969-8423-96fa7c3f4ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:45.201292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fa7be-d2e7-4969-8423-96fa7c3f4ea5 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:45.202644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:00:45.212145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef26cf-8ce8-45dd-83b8-b951f4af13ff None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:45.212624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef26cf-8ce8-45dd-83b8-b951f4af13ff None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:45.212724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef26cf-8ce8-45dd-83b8-b951f4af13ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:45.229794 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-c3ef26cf-8ce8-45dd-83b8-b951f4af13ff None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:45.230970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c3ef26cf-8ce8-45dd-83b8-b951f4af13ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:45.240709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993005b5-c16b-4875-a7d2-d0c650758799 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:45.241016 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993005b5-c16b-4875-a7d2-d0c650758799 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:45.241293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993005b5-c16b-4875-a7d2-d0c650758799 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:45.242647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:00:45.248370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853696-019c-4564-b169-d2a4c6e5affe None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:45.248654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853696-019c-4564-b169-d2a4c6e5affe None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:45.248931 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853696-019c-4564-b169-d2a4c6e5affe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:45.289156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG passlib.handlers.bcrypt [None req-f5853696-019c-4564-b169-d2a4c6e5affe None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80583) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 13:00:45.289582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG passlib.handlers.bcrypt [None req-f5853696-019c-4564-b169-d2a4c6e5affe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80583) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 13:00:45.313621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:00:45.336882 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f5853696-019c-4564-b169-d2a4c6e5affe None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:45.337229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef26cf-8ce8-45dd-83b8-b951f4af13ff None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:45.338501 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f5853696-019c-4564-b169-d2a4c6e5affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:45.361039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:45.440930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:00:45.445069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef26cf-8ce8-45dd-83b8-b951f4af13ff None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:45.463255 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853696-019c-4564-b169-d2a4c6e5affe None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:45.479797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837471f5-e6aa-473a-8af5-84f298482d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:45.480630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837471f5-e6aa-473a-8af5-84f298482d8f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:45.480914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837471f5-e6aa-473a-8af5-84f298482d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:45.481190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837471f5-e6aa-473a-8af5-84f298482d8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:45.494996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837471f5-e6aa-473a-8af5-84f298482d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-837471f5-e6aa-473a-8af5-84f298482d8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:00:45.506338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:00:45.507459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:00:45.508350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:00:45.513710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837471f5-e6aa-473a-8af5-84f298482d8f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:45.566226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853696-019c-4564-b169-d2a4c6e5affe None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:45.568585 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:45.598986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:45.604481 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bf127-9dd6-4f6d-afc4-4d9579f77912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:45.605509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bf127-9dd6-4f6d-afc4-4d9579f77912 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:45.605870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bf127-9dd6-4f6d-afc4-4d9579f77912 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:45.606223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bf127-9dd6-4f6d-afc4-4d9579f77912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:45.620880 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837471f5-e6aa-473a-8af5-84f298482d8f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:45.656432 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02e0f0-a1ea-4bc4-9cfb-bea39f910dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:45.657684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02e0f0-a1ea-4bc4-9cfb-bea39f910dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:45.657970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02e0f0-a1ea-4bc4-9cfb-bea39f910dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:45.658249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02e0f0-a1ea-4bc4-9cfb-bea39f910dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:45.659007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02e0f0-a1ea-4bc4-9cfb-bea39f910dc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:00:45.659316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02e0f0-a1ea-4bc4-9cfb-bea39f910dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:45.660741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02e0f0-a1ea-4bc4-9cfb-bea39f910dc7 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:45.674127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:45.679830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02e0f0-a1ea-4bc4-9cfb-bea39f910dc7 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:45.682221 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bf127-9dd6-4f6d-afc4-4d9579f77912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:45.683754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bf127-9dd6-4f6d-afc4-4d9579f77912 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:45.785055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02e0f0-a1ea-4bc4-9cfb-bea39f910dc7 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:45.786083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:00:45.791778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bf127-9dd6-4f6d-afc4-4d9579f77912 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:45.794618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:45.819137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1b7b8-3496-4be2-877b-b42879b06d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:45.820094 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1b7b8-3496-4be2-877b-b42879b06d57 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:45.820380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1b7b8-3496-4be2-877b-b42879b06d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:45.820660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1b7b8-3496-4be2-877b-b42879b06d57 None admin] PATH_INFO: `/v3/users/ac80ec2c07774b5581b987e15cf3a2d3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:45.821886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1b7b8-3496-4be2-877b-b42879b06d57 None admin] RBAC: Authorizing `identity:get_user(user_id=ac80ec2c07774b5581b987e15cf3a2d3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:45.823354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1b7b8-3496-4be2-877b-b42879b06d57 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:45.825016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:00:45 2022] GET /identity/v3/users/ac80ec2c07774b5581b987e15cf3a2d3 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:00:45.831489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1b7b8-3496-4be2-877b-b42879b06d57 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:45.845466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:45.892357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bf127-9dd6-4f6d-afc4-4d9579f77912 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:45.927238 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2b79-6883-4131-ac28-2ef111131972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:45.928076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2b79-6883-4131-ac28-2ef111131972 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:45.928362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2b79-6883-4131-ac28-2ef111131972 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:45.928638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e2b79-6883-4131-ac28-2ef111131972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:45.930675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1b7b8-3496-4be2-877b-b42879b06d57 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:45.947698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e2b79-6883-4131-ac28-2ef111131972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:45.949213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e2b79-6883-4131-ac28-2ef111131972 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:45.965907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fdcd4-8ca9-45b4-b544-7dc82a2ba0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:45.966709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fdcd4-8ca9-45b4-b544-7dc82a2ba0db None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:45.966992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fdcd4-8ca9-45b4-b544-7dc82a2ba0db None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:45.967286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fdcd4-8ca9-45b4-b544-7dc82a2ba0db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:45.968488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fdcd4-8ca9-45b4-b544-7dc82a2ba0db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:45.969948 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fdcd4-8ca9-45b4-b544-7dc82a2ba0db None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-826e2b79-6883-4131-ac28-2ef111131972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:00:45.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:00:45.971395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:00:45.972499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:00:45.972499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:00:45.972499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:00:45.972499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:00:45.972766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 10/18] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:00:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:00:45.972848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 9/19] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:00:45.977565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fdcd4-8ca9-45b4-b544-7dc82a2ba0db None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:45.978662 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2b79-6883-4131-ac28-2ef111131972 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:46.036398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:46.065186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:46.080824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e2b79-6883-4131-ac28-2ef111131972 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:46.084691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fdcd4-8ca9-45b4-b544-7dc82a2ba0db None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:46.116913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d883bd9-94ac-446d-94a9-824a81814c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:46.117584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d883bd9-94ac-446d-94a9-824a81814c39 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:46.118606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d883bd9-94ac-446d-94a9-824a81814c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:46.118895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d883bd9-94ac-446d-94a9-824a81814c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:46.120045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d883bd9-94ac-446d-94a9-824a81814c39 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.domain.id=default, user.id=ac80ec2c07774b5581b987e15cf3a2d3) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:00:46.120364 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d883bd9-94ac-446d-94a9-824a81814c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:46.121837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d883bd9-94ac-446d-94a9-824a81814c39 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:46.123777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed997-4255-4096-b044-7503d64d464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:46.124481 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed997-4255-4096-b044-7503d64d464b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:46.124763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed997-4255-4096-b044-7503d64d464b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:46.125039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed997-4255-4096-b044-7503d64d464b None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:46.126357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed997-4255-4096-b044-7503d64d464b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:00:46.126663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed997-4255-4096-b044-7503d64d464b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:46.128077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed997-4255-4096-b044-7503d64d464b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:46.131608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1322 bytes} [Thu Jun 2 13:00:45 2022] GET /identity/v3/role_assignments?user.id=ac80ec2c07774b5581b987e15cf3a2d3&scope.domain.id=default&role.id=31c5600d1f984a04827cf0052fc61678 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:00:46.147746 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 11/21] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:48.769506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994dd9-1540-41e0-a0e3-69fee6c6b9f6 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:48.769997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994dd9-1540-41e0-a0e3-69fee6c6b9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:48.769997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994dd9-1540-41e0-a0e3-69fee6c6b9f6 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:48.771848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:00:48.789078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cfd6-cd51-405c-9a1c-31cc1f2f5ec0 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:48.789577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cfd6-cd51-405c-9a1c-31cc1f2f5ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:48.789645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cfd6-cd51-405c-9a1c-31cc1f2f5ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:48.812985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-af82cfd6-cd51-405c-9a1c-31cc1f2f5ec0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:48.814238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-af82cfd6-cd51-405c-9a1c-31cc1f2f5ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:48.900741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:00:48.939995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994dd9-1540-41e0-a0e3-69fee6c6b9f6 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:48.968338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf79d75-eead-4c99-b120-e4ac6f1beaa0 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:48.968633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf79d75-eead-4c99-b120-e4ac6f1beaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:48.968909 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf79d75-eead-4c99-b120-e4ac6f1beaa0 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:48.970858 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:00:48.976919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b43c24-ef7d-4e8f-a9a0-a6e83e395df0 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:48.977217 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b43c24-ef7d-4e8f-a9a0-a6e83e395df0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:48.977508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b43c24-ef7d-4e8f-a9a0-a6e83e395df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:49.007578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-c6b43c24-ef7d-4e8f-a9a0-a6e83e395df0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:49.008830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c6b43c24-ef7d-4e8f-a9a0-a6e83e395df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:49.144783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994dd9-1540-41e0-a0e3-69fee6c6b9f6 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:49.167428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:49.184534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:49.191436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534d67d-b45a-437c-8eea-11d7d745e088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:49.192295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534d67d-b45a-437c-8eea-11d7d745e088 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:49.192585 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534d67d-b45a-437c-8eea-11d7d745e088 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:49.192868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534d67d-b45a-437c-8eea-11d7d745e088 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:49.193215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 14/25] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:00:49.195309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f232a17-63f0-443d-b8fd-ea0997dcb0ee None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:49.195601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f232a17-63f0-443d-b8fd-ea0997dcb0ee None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:49.197676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f232a17-63f0-443d-b8fd-ea0997dcb0ee None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:49.199076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 15/26] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:00:49.205127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade332-1ed2-4861-9b64-6ef5095c00fe None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:49.205417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade332-1ed2-4861-9b64-6ef5095c00fe None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:49.205698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade332-1ed2-4861-9b64-6ef5095c00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:49.217616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534d67d-b45a-437c-8eea-11d7d745e088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-4534d67d-b45a-437c-8eea-11d7d745e088 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:00:49.235280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:00:49.236200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:00:49.236962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 12/27] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:00:49.241134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-73ade332-1ed2-4861-9b64-6ef5095c00fe None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:49.242344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-73ade332-1ed2-4861-9b64-6ef5095c00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:49.244608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534d67d-b45a-437c-8eea-11d7d745e088 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:49.356678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 16/28] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:00:49.357902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade332-1ed2-4861-9b64-6ef5095c00fe None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:49.409461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534d67d-b45a-437c-8eea-11d7d745e088 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:49.460976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb38fa-f296-44f7-b1cf-048f70228b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:49.462448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb38fa-f296-44f7-b1cf-048f70228b72 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:49.462905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb38fa-f296-44f7-b1cf-048f70228b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:49.463673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb38fa-f296-44f7-b1cf-048f70228b72 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:49.464643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb38fa-f296-44f7-b1cf-048f70228b72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:00:49.465356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb38fa-f296-44f7-b1cf-048f70228b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:49.467678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb38fa-f296-44f7-b1cf-048f70228b72 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:49.475113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade332-1ed2-4861-9b64-6ef5095c00fe None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:49.491902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 13/29] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:49.491902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87bdb4-c57f-46f9-b8b2-386c5e74e8d5 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:49.491902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87bdb4-c57f-46f9-b8b2-386c5e74e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:49.491902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87bdb4-c57f-46f9-b8b2-386c5e74e8d5 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:49.491902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 14/30] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:00:49.491902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87bdb4-c57f-46f9-b8b2-386c5e74e8d5 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:49.520979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:49.527362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7ec18-1f43-4cb9-a388-f3a183dd359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:49.528482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7ec18-1f43-4cb9-a388-f3a183dd359c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:49.528977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7ec18-1f43-4cb9-a388-f3a183dd359c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:49.529450 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7ec18-1f43-4cb9-a388-f3a183dd359c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:49.540924 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7ec18-1f43-4cb9-a388-f3a183dd359c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:49.543056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7ec18-1f43-4cb9-a388-f3a183dd359c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:49.556841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-85f7ec18-1f43-4cb9-a388-f3a183dd359c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:00:49.565474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:00:49.566326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:00:49.567110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:00:49.567110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:00:49.567110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:00:49.567110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:00:49.569109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 17/31] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:00:49.574818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7ec18-1f43-4cb9-a388-f3a183dd359c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:49.636229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87bdb4-c57f-46f9-b8b2-386c5e74e8d5 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:49.674716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82875b03-5def-4c58-b152-680996cfaecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:49.675740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875b03-5def-4c58-b152-680996cfaecd None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:49.676195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875b03-5def-4c58-b152-680996cfaecd None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:49.676634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875b03-5def-4c58-b152-680996cfaecd None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:49.677586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82875b03-5def-4c58-b152-680996cfaecd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:49.679398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82875b03-5def-4c58-b152-680996cfaecd None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:49.688735 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7ec18-1f43-4cb9-a388-f3a183dd359c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:49.727125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87fb1f-c344-4007-ac93-80c1216cb52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:49.728490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87fb1f-c344-4007-ac93-80c1216cb52a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:49.728490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87fb1f-c344-4007-ac93-80c1216cb52a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:49.728806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87fb1f-c344-4007-ac93-80c1216cb52a None admin] PATH_INFO: `/v3/users/ac80ec2c07774b5581b987e15cf3a2d3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:49.730221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87fb1f-c344-4007-ac93-80c1216cb52a None admin] RBAC: Authorizing `identity:get_user(user_id=ac80ec2c07774b5581b987e15cf3a2d3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:49.731742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87fb1f-c344-4007-ac93-80c1216cb52a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:49.733869 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 18/32] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:00:49 2022] GET /identity/v3/users/ac80ec2c07774b5581b987e15cf3a2d3 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:49.735340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3b339-f868-4f31-94ce-1682dc95115e None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:49.735795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3b339-f868-4f31-94ce-1682dc95115e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:49.740626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3b339-f868-4f31-94ce-1682dc95115e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:49.755715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-aaf3b339-f868-4f31-94ce-1682dc95115e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:49.757318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-aaf3b339-f868-4f31-94ce-1682dc95115e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:49.808947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:49.833135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 19/33] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:00:49.834306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3b339-f868-4f31-94ce-1682dc95115e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:49.944417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3b339-f868-4f31-94ce-1682dc95115e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:49.964918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 15/34] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Jun 2 13:00:49 2022] POST /identity/v3/roles => generated 219 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:00:49.966743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82875b03-5def-4c58-b152-680996cfaecd None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:50.000306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9ca2d-4d67-4c1a-a8eb-a499cf847ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:50.002377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ca2d-4d67-4c1a-a8eb-a499cf847ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:50.003820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ca2d-4d67-4c1a-a8eb-a499cf847ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:50.004534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ca2d-4d67-4c1a-a8eb-a499cf847ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:50.006961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9ca2d-4d67-4c1a-a8eb-a499cf847ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:00:50.007498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9ca2d-4d67-4c1a-a8eb-a499cf847ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:50.009259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9ca2d-4d67-4c1a-a8eb-a499cf847ee5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:50.035329 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 20/35] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:50.038089 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9ca2d-4d67-4c1a-a8eb-a499cf847ee5 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:50.129895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82875b03-5def-4c58-b152-680996cfaecd None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:50.132175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:50.143978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:50.196912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de39a-1ec9-4601-b14e-986a430e1018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:50.197725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de39a-1ec9-4601-b14e-986a430e1018 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:50.198013 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de39a-1ec9-4601-b14e-986a430e1018 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:50.198354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de39a-1ec9-4601-b14e-986a430e1018 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:50.200137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151de39a-1ec9-4601-b14e-986a430e1018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:50.202041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151de39a-1ec9-4601-b14e-986a430e1018 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:50.203746 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 16/36] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:00:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:50.207369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de39a-1ec9-4601-b14e-986a430e1018 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:50.257672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9ca2d-4d67-4c1a-a8eb-a499cf847ee5 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:50.310882 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2179-feb3-4e56-a139-66df337324ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:50.311588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2179-feb3-4e56-a139-66df337324ac None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:50.311908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2179-feb3-4e56-a139-66df337324ac None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:50.312196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2179-feb3-4e56-a139-66df337324ac None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:50.313025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b2179-feb3-4e56-a139-66df337324ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:50.314754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b2179-feb3-4e56-a139-66df337324ac None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:50.369889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de39a-1ec9-4601-b14e-986a430e1018 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:50.412421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54a5cb-fb27-47bc-beb9-13beaca3305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:50.413141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54a5cb-fb27-47bc-beb9-13beaca3305c None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:50.413434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54a5cb-fb27-47bc-beb9-13beaca3305c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:50.413716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54a5cb-fb27-47bc-beb9-13beaca3305c None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:50.414436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54a5cb-fb27-47bc-beb9-13beaca3305c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:50.415932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54a5cb-fb27-47bc-beb9-13beaca3305c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:50.493679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 21/37] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Jun 2 13:00:50 2022] POST /identity/v3/roles => generated 225 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:00:50.494852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2179-feb3-4e56-a139-66df337324ac None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:50.507242 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 17/38] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:00:50 2022] POST /identity/v3/projects => generated 301 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:00:50.509565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b001822-791c-410a-b502-0506e0e0251b None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:50.510127 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b001822-791c-410a-b502-0506e0e0251b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:50.510622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b001822-791c-410a-b502-0506e0e0251b None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:50.517860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 18/39] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:00:50.519919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d637a-462a-4e7b-be23-0d81aea51038 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:50.520569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d637a-462a-4e7b-be23-0d81aea51038 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:50.521051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d637a-462a-4e7b-be23-0d81aea51038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:50.560490 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b46d637a-462a-4e7b-be23-0d81aea51038 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:50.563468 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b46d637a-462a-4e7b-be23-0d81aea51038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:50.612866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:50.695531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:50.699115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2179-feb3-4e56-a139-66df337324ac None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:50.713385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 19/40] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:00:50.715220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db42f-daf3-4782-bf3f-e66ec390355a None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:50.715682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db42f-daf3-4782-bf3f-e66ec390355a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:50.717841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43db42f-daf3-4782-bf3f-e66ec390355a None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:50.717841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 20/41] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:00:50.726606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5992-2cb9-49b7-bc6e-782028f13976 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:50.726606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5992-2cb9-49b7-bc6e-782028f13976 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:50.726606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa5992-2cb9-49b7-bc6e-782028f13976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:50.747331 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-fafa5992-2cb9-49b7-bc6e-782028f13976 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:50.749019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fafa5992-2cb9-49b7-bc6e-782028f13976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:50.774202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafc38d-7c4a-4489-8f04-1ff9a33955bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:50.775018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafc38d-7c4a-4489-8f04-1ff9a33955bc None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:50.775311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafc38d-7c4a-4489-8f04-1ff9a33955bc None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:50.775610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafc38d-7c4a-4489-8f04-1ff9a33955bc None admin] PATH_INFO: `/v3/domains/default/users/ac80ec2c07774b5581b987e15cf3a2d3/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:50.778522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafc38d-7c4a-4489-8f04-1ff9a33955bc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ac80ec2c07774b5581b987e15cf3a2d3, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:50.780458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafc38d-7c4a-4489-8f04-1ff9a33955bc None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:50.838298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 21/42] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:00:50.839171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa5992-2cb9-49b7-bc6e-782028f13976 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:50.850324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 22/43] 10.222.0.46 () {58 vars in 1361 bytes} [Thu Jun 2 13:00:50 2022] PUT /identity/v3/domains/default/users/ac80ec2c07774b5581b987e15cf3a2d3/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:00:50.865263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafc38d-7c4a-4489-8f04-1ff9a33955bc None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:50.957382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:50.980779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa5992-2cb9-49b7-bc6e-782028f13976 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:50.993295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafc38d-7c4a-4489-8f04-1ff9a33955bc None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:51.033172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e603e99-07ba-4fbd-bf42-713dad6cc84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:51.033913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e603e99-07ba-4fbd-bf42-713dad6cc84f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:51.034202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e603e99-07ba-4fbd-bf42-713dad6cc84f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:51.034475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e603e99-07ba-4fbd-bf42-713dad6cc84f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:51.035734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e603e99-07ba-4fbd-bf42-713dad6cc84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:51.037284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e603e99-07ba-4fbd-bf42-713dad6cc84f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:51.041776 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 23/44] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:00:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:00:51.042387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97108270-9191-4332-a884-7279a9eea8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:51.042832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108270-9191-4332-a884-7279a9eea8ca None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:51.043126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108270-9191-4332-a884-7279a9eea8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:51.043494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108270-9191-4332-a884-7279a9eea8ca None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:51.044320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97108270-9191-4332-a884-7279a9eea8ca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:51.044754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e603e99-07ba-4fbd-bf42-713dad6cc84f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:51.046128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97108270-9191-4332-a884-7279a9eea8ca None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:51.074670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:51.113172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Jun 2 13:00:50 2022] POST /identity/v3/roles => generated 223 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:00:51.155130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e603e99-07ba-4fbd-bf42-713dad6cc84f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:51.195434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186b64b-cf6f-4125-8b1c-8e0ee8d2b2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:51.196140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b64b-cf6f-4125-8b1c-8e0ee8d2b2db None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:51.196425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b64b-cf6f-4125-8b1c-8e0ee8d2b2db None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:51.196701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b64b-cf6f-4125-8b1c-8e0ee8d2b2db None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:51.197452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186b64b-cf6f-4125-8b1c-8e0ee8d2b2db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:51.198987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186b64b-cf6f-4125-8b1c-8e0ee8d2b2db None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:51.279891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:00:51 2022] POST /identity/v3/projects => generated 312 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:00:53.131058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c02d22-7a64-466c-b846-5b27e1b5dfa9 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:53.131583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c02d22-7a64-466c-b846-5b27e1b5dfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:53.131664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c02d22-7a64-466c-b846-5b27e1b5dfa9 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:53.133011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 23/47] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:00:53.138298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca853c9-4ce2-4fbb-96a1-b15355a62cd7 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:53.138727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca853c9-4ce2-4fbb-96a1-b15355a62cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:53.138879 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca853c9-4ce2-4fbb-96a1-b15355a62cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:53.156170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-eca853c9-4ce2-4fbb-96a1-b15355a62cd7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:53.158311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-eca853c9-4ce2-4fbb-96a1-b15355a62cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:53.224960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 25/48] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:00:53.249789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c02d22-7a64-466c-b846-5b27e1b5dfa9 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:53.356067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c02d22-7a64-466c-b846-5b27e1b5dfa9 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:53.392949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d6416-6a03-4724-9797-48088c026ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:53.393754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d6416-6a03-4724-9797-48088c026ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:53.393981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d6416-6a03-4724-9797-48088c026ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:53.394260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d6416-6a03-4724-9797-48088c026ee9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:53.407304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d6416-6a03-4724-9797-48088c026ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-e17d6416-6a03-4724-9797-48088c026ee9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:00:53.415326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:00:53.416351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:00:53.417159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 24/49] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:00:53.423286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca853c9-4ce2-4fbb-96a1-b15355a62cd7 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:53.434772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:53.518960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca853c9-4ce2-4fbb-96a1-b15355a62cd7 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:53.552714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ddb1d-a3d3-4342-9775-3e9e40238f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:53.553402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ddb1d-a3d3-4342-9775-3e9e40238f6d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:53.553692 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ddb1d-a3d3-4342-9775-3e9e40238f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:53.553977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ddb1d-a3d3-4342-9775-3e9e40238f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:53.554728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ddb1d-a3d3-4342-9775-3e9e40238f6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:00:53.555039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ddb1d-a3d3-4342-9775-3e9e40238f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:53.556482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ddb1d-a3d3-4342-9775-3e9e40238f6d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:53.565269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 26/50] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:53.570723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d6416-6a03-4724-9797-48088c026ee9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:53.575119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:53.678757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d6416-6a03-4724-9797-48088c026ee9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:53.711930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0f72c-609e-45eb-9487-aa1a6fa5775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:53.712821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0f72c-609e-45eb-9487-aa1a6fa5775f None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:53.713107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0f72c-609e-45eb-9487-aa1a6fa5775f None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:53.713393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0f72c-609e-45eb-9487-aa1a6fa5775f None admin] PATH_INFO: `/v3/users/ac80ec2c07774b5581b987e15cf3a2d3` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:53.714831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0f72c-609e-45eb-9487-aa1a6fa5775f None admin] RBAC: Authorizing `identity:get_user(user_id=ac80ec2c07774b5581b987e15cf3a2d3)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:53.716322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0f72c-609e-45eb-9487-aa1a6fa5775f None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:53.717960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 25/51] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:00:53 2022] GET /identity/v3/users/ac80ec2c07774b5581b987e15cf3a2d3 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:53.724002 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ddb1d-a3d3-4342-9775-3e9e40238f6d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:53.754096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9f0c-6998-4ee7-b969-502fd770afca None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:53.754407 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9f0c-6998-4ee7-b969-502fd770afca None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:53.754718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9f0c-6998-4ee7-b969-502fd770afca None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:53.756218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 26/52] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:00:53.761710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e5631-4eaa-4ba5-9fc7-29d409c6b82a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:53.762003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e5631-4eaa-4ba5-9fc7-29d409c6b82a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:53.762284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e5631-4eaa-4ba5-9fc7-29d409c6b82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:53.779361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-872e5631-4eaa-4ba5-9fc7-29d409c6b82a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:53.780638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-872e5631-4eaa-4ba5-9fc7-29d409c6b82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:53.794583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:53.823888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ddb1d-a3d3-4342-9775-3e9e40238f6d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:53.851707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:53.856495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 27/53] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:00:53.859439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d1582-3d81-4976-a134-5923defd71b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:53.860428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d1582-3d81-4976-a134-5923defd71b3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:53.860773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d1582-3d81-4976-a134-5923defd71b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:53.861107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d1582-3d81-4976-a134-5923defd71b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:53.862557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d1582-3d81-4976-a134-5923defd71b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:53.864137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d1582-3d81-4976-a134-5923defd71b3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:53.865754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 27/54] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:53.871704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e5631-4eaa-4ba5-9fc7-29d409c6b82a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:53.879640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d1582-3d81-4976-a134-5923defd71b3 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:53.970335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e5631-4eaa-4ba5-9fc7-29d409c6b82a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:53.977756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d1582-3d81-4976-a134-5923defd71b3 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:54.005530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2641efe-f99b-458e-826a-7a032ad8256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:54.006194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2641efe-f99b-458e-826a-7a032ad8256f None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:54.006485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2641efe-f99b-458e-826a-7a032ad8256f None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:54.006771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2641efe-f99b-458e-826a-7a032ad8256f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:54.007672 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2641efe-f99b-458e-826a-7a032ad8256f None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.domain.id=default, user.id=ac80ec2c07774b5581b987e15cf3a2d3) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:00:54.007958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2641efe-f99b-458e-826a-7a032ad8256f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:54.009407 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2641efe-f99b-458e-826a-7a032ad8256f None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:54.010460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6615ee-9f07-4b32-a4e4-0e0fa0059b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:54.011301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6615ee-9f07-4b32-a4e4-0e0fa0059b86 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:54.011586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6615ee-9f07-4b32-a4e4-0e0fa0059b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:54.011892 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6615ee-9f07-4b32-a4e4-0e0fa0059b86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:54.013066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6615ee-9f07-4b32-a4e4-0e0fa0059b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:54.014523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6615ee-9f07-4b32-a4e4-0e0fa0059b86 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:54.015266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1322 bytes} [Thu Jun 2 13:00:53 2022] GET /identity/v3/role_assignments?user.id=ac80ec2c07774b5581b987e15cf3a2d3&scope.domain.id=default&role.id=31c5600d1f984a04827cf0052fc61678 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:54.021173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 28/56] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:00:54.025058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2641efe-f99b-458e-826a-7a032ad8256f None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:54.093783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:54.136485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2641efe-f99b-458e-826a-7a032ad8256f None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:54.173947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a4486-90a5-43cf-a36f-ddd4c7a2ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:54.174635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4486-90a5-43cf-a36f-ddd4c7a2ab66 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:54.174923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4486-90a5-43cf-a36f-ddd4c7a2ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:54.175204 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4486-90a5-43cf-a36f-ddd4c7a2ab66 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:54.175963 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a4486-90a5-43cf-a36f-ddd4c7a2ab66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:54.177466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a4486-90a5-43cf-a36f-ddd4c7a2ab66 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:54.238838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 29/57] 10.222.0.46 () {60 vars in 1140 bytes} [Thu Jun 2 13:00:54 2022] POST /identity/v3/projects => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:00:56.607757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f14594-5eca-42ae-8876-8a3e642e4ac6 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:56.608289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f14594-5eca-42ae-8876-8a3e642e4ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:56.608377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f14594-5eca-42ae-8876-8a3e642e4ac6 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:56.610224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 29/58] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:00:56.615333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048438a2-2027-4b3d-884e-93d792934e3a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:56.615731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048438a2-2027-4b3d-884e-93d792934e3a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:56.615912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048438a2-2027-4b3d-884e-93d792934e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:56.633704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-048438a2-2027-4b3d-884e-93d792934e3a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:00:56.634995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-048438a2-2027-4b3d-884e-93d792934e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:00:56.700818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 30/59] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:00:56.725683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f14594-5eca-42ae-8876-8a3e642e4ac6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:56.738005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:56.825779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f14594-5eca-42ae-8876-8a3e642e4ac6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:56.856967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f263-3511-4765-8307-5fcbff6bb8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:56.857756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f263-3511-4765-8307-5fcbff6bb8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:56.858041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f263-3511-4765-8307-5fcbff6bb8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:56.858318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f263-3511-4765-8307-5fcbff6bb8d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:56.860043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f263-3511-4765-8307-5fcbff6bb8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:56.861506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f263-3511-4765-8307-5fcbff6bb8d8 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:56.863110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 30/60] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:00:56.868853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048438a2-2027-4b3d-884e-93d792934e3a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:00:56.917918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:00:56.976706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048438a2-2027-4b3d-884e-93d792934e3a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:00:57.020310 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcae498-0e6d-4be7-94f5-5a9abd3e6371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:00:57.021041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcae498-0e6d-4be7-94f5-5a9abd3e6371 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:00:57.021390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcae498-0e6d-4be7-94f5-5a9abd3e6371 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:00:57.021726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcae498-0e6d-4be7-94f5-5a9abd3e6371 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:00:57.022589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcae498-0e6d-4be7-94f5-5a9abd3e6371 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:00:57.024349 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcae498-0e6d-4be7-94f5-5a9abd3e6371 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:00:57.129568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 31/61] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:00:56 2022] POST /identity/v3/users => generated 275 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:00.391919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e3127-634d-49ab-a52a-f43f64ada1a4 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:00.391919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e3127-634d-49ab-a52a-f43f64ada1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:00.391919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e3127-634d-49ab-a52a-f43f64ada1a4 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:00.393245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 31/62] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:00.398435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75c90-c0f3-4ef6-95da-c13a6675f8de None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:00.399282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75c90-c0f3-4ef6-95da-c13a6675f8de None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:00.399770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75c90-c0f3-4ef6-95da-c13a6675f8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:00.421531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b2b75c90-c0f3-4ef6-95da-c13a6675f8de None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:00.423088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b2b75c90-c0f3-4ef6-95da-c13a6675f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:00.542671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 32/63] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:00.578290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e3127-634d-49ab-a52a-f43f64ada1a4 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:00.657199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b475bd-8a66-4435-afa3-f14ece87fa15 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:00.657902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b475bd-8a66-4435-afa3-f14ece87fa15 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:00.658617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b475bd-8a66-4435-afa3-f14ece87fa15 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:00.660843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 33/64] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:00.666678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a3721-f093-40da-aa6f-83cc5a68919a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:00.667433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a3721-f093-40da-aa6f-83cc5a68919a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:00.668095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a3721-f093-40da-aa6f-83cc5a68919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:00.697468 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0f5a3721-f093-40da-aa6f-83cc5a68919a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:00.698979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0f5a3721-f093-40da-aa6f-83cc5a68919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:00.709236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:00.717803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e3127-634d-49ab-a52a-f43f64ada1a4 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:00.756243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:00.791596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a220c5f-9fad-4c22-8272-1c33dd7dffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:00.792446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a220c5f-9fad-4c22-8272-1c33dd7dffa6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:00.792736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a220c5f-9fad-4c22-8272-1c33dd7dffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:00.793018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a220c5f-9fad-4c22-8272-1c33dd7dffa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:00.817149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a220c5f-9fad-4c22-8272-1c33dd7dffa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-5a220c5f-9fad-4c22-8272-1c33dd7dffa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:00.825444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:00.826500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:00.827414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:00.829521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 32/65] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:00.834169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 34/66] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:00.835299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a220c5f-9fad-4c22-8272-1c33dd7dffa6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:00.854574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a3721-f093-40da-aa6f-83cc5a68919a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:00.982565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a3721-f093-40da-aa6f-83cc5a68919a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:00.983693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a220c5f-9fad-4c22-8272-1c33dd7dffa6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:01.022715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cc67f-aad0-4fc4-af62-fb8a784596dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:01.024053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cc67f-aad0-4fc4-af62-fb8a784596dc None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.024562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cc67f-aad0-4fc4-af62-fb8a784596dc None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.025113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cc67f-aad0-4fc4-af62-fb8a784596dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.033307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60010e05-6bca-464b-967a-f9a20e801915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:01.034365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60010e05-6bca-464b-967a-f9a20e801915 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.034768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60010e05-6bca-464b-967a-f9a20e801915 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.035520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60010e05-6bca-464b-967a-f9a20e801915 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.036410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60010e05-6bca-464b-967a-f9a20e801915 None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:01.036792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60010e05-6bca-464b-967a-f9a20e801915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:01.038572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60010e05-6bca-464b-967a-f9a20e801915 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:01.039055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cc67f-aad0-4fc4-af62-fb8a784596dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:01.045102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-8f8cc67f-aad0-4fc4-af62-fb8a784596dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:01.047649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:01.048605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:01.049354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 35/67] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:01:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:01.049977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 33/68] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:01.050786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327799-a3c3-4836-a216-7491c37a55d2 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.051174 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea2b66-7d83-406c-a2a4-c07a5aa7b8f9 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.051491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327799-a3c3-4836-a216-7491c37a55d2 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.051701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea2b66-7d83-406c-a2a4-c07a5aa7b8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.052112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea2b66-7d83-406c-a2a4-c07a5aa7b8f9 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.052220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80327799-a3c3-4836-a216-7491c37a55d2 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.053904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 34/69] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:01.055670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327799-a3c3-4836-a216-7491c37a55d2 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:01.058430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 36/70] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:01.059465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea2b66-7d83-406c-a2a4-c07a5aa7b8f9 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:01.090359 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:01.175806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80327799-a3c3-4836-a216-7491c37a55d2 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:01.181368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea2b66-7d83-406c-a2a4-c07a5aa7b8f9 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:01.220761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a90b2-5676-4b52-90a6-606aea721eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:01.221986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a90b2-5676-4b52-90a6-606aea721eaa None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.222443 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a90b2-5676-4b52-90a6-606aea721eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.222937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a90b2-5676-4b52-90a6-606aea721eaa None admin] PATH_INFO: `/v3/users/4d880a26c97040af9607efb3a077fe5f` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.226801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88390f5e-74ad-415d-ae1c-0b6417603e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:01.227352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88390f5e-74ad-415d-ae1c-0b6417603e26 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.227639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88390f5e-74ad-415d-ae1c-0b6417603e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.227966 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88390f5e-74ad-415d-ae1c-0b6417603e26 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.228715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88390f5e-74ad-415d-ae1c-0b6417603e26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:01.229028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88390f5e-74ad-415d-ae1c-0b6417603e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:01.230432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88390f5e-74ad-415d-ae1c-0b6417603e26 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:01.239365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 37/71] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:01.240966 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2cc58-2fec-420c-911b-037402f628ca None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.241352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2cc58-2fec-420c-911b-037402f628ca None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.241690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2cc58-2fec-420c-911b-037402f628ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.247021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a90b2-5676-4b52-90a6-606aea721eaa None admin] RBAC: Authorizing `identity:get_user(user_id=4d880a26c97040af9607efb3a077fe5f)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:01.248582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a90b2-5676-4b52-90a6-606aea721eaa None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:01.255150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 35/72] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:01 2022] GET /identity/v3/users/4d880a26c97040af9607efb3a077fe5f => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:01.255150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0f5de-1a3e-4df7-826b-d929c287d386 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.255150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0f5de-1a3e-4df7-826b-d929c287d386 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.255150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0f5de-1a3e-4df7-826b-d929c287d386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.261592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-25f2cc58-2fec-420c-911b-037402f628ca None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:01.262783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-25f2cc58-2fec-420c-911b-037402f628ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:01.276855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0eb0f5de-1a3e-4df7-826b-d929c287d386 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:01.278076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0eb0f5de-1a3e-4df7-826b-d929c287d386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:01.335161 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:01.347546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 38/73] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:01.348644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2cc58-2fec-420c-911b-037402f628ca None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:01.365882 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:01.366799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 36/74] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:01.368322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0f5de-1a3e-4df7-826b-d929c287d386 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:01.471281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2cc58-2fec-420c-911b-037402f628ca None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:01.485167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0f5de-1a3e-4df7-826b-d929c287d386 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:01.506919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6379ae-dbc2-497f-835c-84a3c8c9fc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:01.507735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6379ae-dbc2-497f-835c-84a3c8c9fc2f None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.508066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6379ae-dbc2-497f-835c-84a3c8c9fc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.508346 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6379ae-dbc2-497f-835c-84a3c8c9fc2f None admin] PATH_INFO: `/v3/users/ac80ec2c07774b5581b987e15cf3a2d3` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.509544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6379ae-dbc2-497f-835c-84a3c8c9fc2f None admin] RBAC: Authorizing `identity:get_user(user_id=ac80ec2c07774b5581b987e15cf3a2d3)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:01.511002 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6379ae-dbc2-497f-835c-84a3c8c9fc2f None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:01.512753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 39/75] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:01 2022] GET /identity/v3/users/ac80ec2c07774b5581b987e15cf3a2d3 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:01.513526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6379ae-dbc2-497f-835c-84a3c8c9fc2f None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:01.523325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a957d-4ba5-4aa9-98ec-fc53063dd0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:01.524013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a957d-4ba5-4aa9-98ec-fc53063dd0de None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.524302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a957d-4ba5-4aa9-98ec-fc53063dd0de None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.524584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a957d-4ba5-4aa9-98ec-fc53063dd0de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.579886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:01.592736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a957d-4ba5-4aa9-98ec-fc53063dd0de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:01.594792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a957d-4ba5-4aa9-98ec-fc53063dd0de None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:01.600245 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:01.620397 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6379ae-dbc2-497f-835c-84a3c8c9fc2f None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:01.654842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12956909-a2fc-4063-a13b-b0516d76b1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:01.655770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12956909-a2fc-4063-a13b-b0516d76b1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.656111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12956909-a2fc-4063-a13b-b0516d76b1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.656391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12956909-a2fc-4063-a13b-b0516d76b1f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.666610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12956909-a2fc-4063-a13b-b0516d76b1f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-12956909-a2fc-4063-a13b-b0516d76b1f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:01.676409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:01.677290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:01.678302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 40/76] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:01.679157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12956909-a2fc-4063-a13b-b0516d76b1f3 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:01.712524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 37/77] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:01.712524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9371d64-d287-4611-a766-aaaac2a08ede None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.712524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9371d64-d287-4611-a766-aaaac2a08ede None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.712524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9371d64-d287-4611-a766-aaaac2a08ede None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.712524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 38/78] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:01.713226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9371d64-d287-4611-a766-aaaac2a08ede None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:01.784406 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12956909-a2fc-4063-a13b-b0516d76b1f3 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:01.805687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:01.820413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f16d63-7e4e-44a4-bd7e-d5ce0a2caab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:01.821354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f16d63-7e4e-44a4-bd7e-d5ce0a2caab9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.824661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f16d63-7e4e-44a4-bd7e-d5ce0a2caab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.824661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f16d63-7e4e-44a4-bd7e-d5ce0a2caab9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.824832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9371d64-d287-4611-a766-aaaac2a08ede None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:01.832895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f16d63-7e4e-44a4-bd7e-d5ce0a2caab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-16f16d63-7e4e-44a4-bd7e-d5ce0a2caab9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:01.840605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:01.841432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:01.842265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 41/79] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:01.842902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f16d63-7e4e-44a4-bd7e-d5ce0a2caab9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:01.846561 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:01.863459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7d73-750d-4b2a-89e6-f8fdafc27b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:01.864974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7d73-750d-4b2a-89e6-f8fdafc27b81 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.864974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7d73-750d-4b2a-89e6-f8fdafc27b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.864974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7d73-750d-4b2a-89e6-f8fdafc27b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.933993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab7d73-750d-4b2a-89e6-f8fdafc27b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:01.935650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab7d73-750d-4b2a-89e6-f8fdafc27b81 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:01.946557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f16d63-7e4e-44a4-bd7e-d5ce0a2caab9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:01.979053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff251ee-e93a-4e41-960d-1cdf389ecc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:01.979723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff251ee-e93a-4e41-960d-1cdf389ecc08 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:01.980040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff251ee-e93a-4e41-960d-1cdf389ecc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:01.980321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff251ee-e93a-4e41-960d-1cdf389ecc08 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:01.981070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff251ee-e93a-4e41-960d-1cdf389ecc08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:01.981382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff251ee-e93a-4e41-960d-1cdf389ecc08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:01.982763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff251ee-e93a-4e41-960d-1cdf389ecc08 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:01.990999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 42/80] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:01.991794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff251ee-e93a-4e41-960d-1cdf389ecc08 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.020394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:02.036847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 39/81] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:02.038067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223fc29-7ca2-48f3-bcba-b9631f608183 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.038387 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223fc29-7ca2-48f3-bcba-b9631f608183 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.038670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223fc29-7ca2-48f3-bcba-b9631f608183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.055820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4223fc29-7ca2-48f3-bcba-b9631f608183 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:02.057061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4223fc29-7ca2-48f3-bcba-b9631f608183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:02.060233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:02.097940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff251ee-e93a-4e41-960d-1cdf389ecc08 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:02.124783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 40/82] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:02.125669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223fc29-7ca2-48f3-bcba-b9631f608183 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.144467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74419fb6-7c04-484d-bb9e-8689ddfe989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:02.145346 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74419fb6-7c04-484d-bb9e-8689ddfe989e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.145634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74419fb6-7c04-484d-bb9e-8689ddfe989e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.145912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74419fb6-7c04-484d-bb9e-8689ddfe989e None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.147549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74419fb6-7c04-484d-bb9e-8689ddfe989e None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:02.149125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74419fb6-7c04-484d-bb9e-8689ddfe989e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:02.150833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 43/83] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:01 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:02.151615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74419fb6-7c04-484d-bb9e-8689ddfe989e None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.225473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223fc29-7ca2-48f3-bcba-b9631f608183 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:02.250432 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:02.257357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74419fb6-7c04-484d-bb9e-8689ddfe989e None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:02.268204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011c4c5-0b91-4833-a68e-24b1731e8693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:02.269103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011c4c5-0b91-4833-a68e-24b1731e8693 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.269391 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011c4c5-0b91-4833-a68e-24b1731e8693 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.269697 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011c4c5-0b91-4833-a68e-24b1731e8693 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.270500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011c4c5-0b91-4833-a68e-24b1731e8693 None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:02.270826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011c4c5-0b91-4833-a68e-24b1731e8693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:02.272312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011c4c5-0b91-4833-a68e-24b1731e8693 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:02.280794 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 41/84] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:02.282256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011c4c5-0b91-4833-a68e-24b1731e8693 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.287624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:02.292726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a7e7-8f0d-46ec-b237-6b8870527767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:02.293612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a7e7-8f0d-46ec-b237-6b8870527767 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.293900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a7e7-8f0d-46ec-b237-6b8870527767 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.294177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a7e7-8f0d-46ec-b237-6b8870527767 None admin] PATH_INFO: `/v3/users/4d880a26c97040af9607efb3a077fe5f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.295386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2a7e7-8f0d-46ec-b237-6b8870527767 None admin] RBAC: Authorizing `identity:get_user(user_id=4d880a26c97040af9607efb3a077fe5f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:02.296919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2a7e7-8f0d-46ec-b237-6b8870527767 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:02.298538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 44/85] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:02 2022] GET /identity/v3/users/4d880a26c97040af9607efb3a077fe5f => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:02.299306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a7e7-8f0d-46ec-b237-6b8870527767 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.389993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011c4c5-0b91-4833-a68e-24b1731e8693 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:02.409773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a7e7-8f0d-46ec-b237-6b8870527767 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:02.425168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b731b-34c0-48e5-afc2-265b89bf88f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:02.426069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b731b-34c0-48e5-afc2-265b89bf88f4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.426328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b731b-34c0-48e5-afc2-265b89bf88f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.426605 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b731b-34c0-48e5-afc2-265b89bf88f4 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.427900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b731b-34c0-48e5-afc2-265b89bf88f4 None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:02.429431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b731b-34c0-48e5-afc2-265b89bf88f4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:02.431056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 42/86] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:02 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:02.431823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b731b-34c0-48e5-afc2-265b89bf88f4 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.444454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056ec7f-ee96-4462-8dbd-49144fe54d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:02.445300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056ec7f-ee96-4462-8dbd-49144fe54d01 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.445591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056ec7f-ee96-4462-8dbd-49144fe54d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.445891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056ec7f-ee96-4462-8dbd-49144fe54d01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.447126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056ec7f-ee96-4462-8dbd-49144fe54d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:02.448709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056ec7f-ee96-4462-8dbd-49144fe54d01 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:02.450422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 45/87] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:02.451243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056ec7f-ee96-4462-8dbd-49144fe54d01 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.484521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:02.519378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:02.537757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b731b-34c0-48e5-afc2-265b89bf88f4 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:02.552941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056ec7f-ee96-4462-8dbd-49144fe54d01 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:02.571506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2738-da73-4c70-ab1d-a44a77d7c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:02.572244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2738-da73-4c70-ab1d-a44a77d7c678 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.572558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2738-da73-4c70-ab1d-a44a77d7c678 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.572846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2738-da73-4c70-ab1d-a44a77d7c678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.573725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a2738-da73-4c70-ab1d-a44a77d7c678 None admin] RBAC: Adding query filter params (role.id=b35814b03f814680843c3aead86264f7, scope.project.id=54da9f11da824072acb54f348da7e461, user.id=4d880a26c97040af9607efb3a077fe5f) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:02.574066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a2738-da73-4c70-ab1d-a44a77d7c678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:02.575630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a2738-da73-4c70-ab1d-a44a77d7c678 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:02.583290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 43/88] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:02 2022] GET /identity/v3/role_assignments?user.id=4d880a26c97040af9607efb3a077fe5f&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=b35814b03f814680843c3aead86264f7 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:02.584177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2738-da73-4c70-ab1d-a44a77d7c678 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.589510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e3937-ad9f-4a91-926f-5573789b8d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:02.590655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3937-ad9f-4a91-926f-5573789b8d1a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.591087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3937-ad9f-4a91-926f-5573789b8d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.591508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3937-ad9f-4a91-926f-5573789b8d1a None admin] PATH_INFO: `/v3/users/4d880a26c97040af9607efb3a077fe5f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.593153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e3937-ad9f-4a91-926f-5573789b8d1a None admin] RBAC: Authorizing `identity:get_user(user_id=4d880a26c97040af9607efb3a077fe5f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:02.595521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e3937-ad9f-4a91-926f-5573789b8d1a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:02.598980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 46/89] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:02 2022] GET /identity/v3/users/4d880a26c97040af9607efb3a077fe5f => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:02.600111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e3937-ad9f-4a91-926f-5573789b8d1a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.706435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2738-da73-4c70-ab1d-a44a77d7c678 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:02.718418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:02.723747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e3937-ad9f-4a91-926f-5573789b8d1a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:02.743915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c6718-1cce-4cb4-89c5-333765dd336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:02.744613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c6718-1cce-4cb4-89c5-333765dd336b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.745031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c6718-1cce-4cb4-89c5-333765dd336b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.745320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c6718-1cce-4cb4-89c5-333765dd336b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.765223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a8b5-ff5b-460d-ad02-e78466d73767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:02.766518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a8b5-ff5b-460d-ad02-e78466d73767 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.766836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a8b5-ff5b-460d-ad02-e78466d73767 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.767142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689a8b5-ff5b-460d-ad02-e78466d73767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.768097 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689a8b5-ff5b-460d-ad02-e78466d73767 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=54da9f11da824072acb54f348da7e461, user.id=ac80ec2c07774b5581b987e15cf3a2d3) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:02.768438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689a8b5-ff5b-460d-ad02-e78466d73767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:02.770032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689a8b5-ff5b-460d-ad02-e78466d73767 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:02.774343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:02.778348 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 47/90] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:02 2022] GET /identity/v3/role_assignments?user.id=ac80ec2c07774b5581b987e15cf3a2d3&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=31c5600d1f984a04827cf0052fc61678 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:02.779247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a8b5-ff5b-460d-ad02-e78466d73767 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.847034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c6718-1cce-4cb4-89c5-333765dd336b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:02.848824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c6718-1cce-4cb4-89c5-333765dd336b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:02.927694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689a8b5-ff5b-460d-ad02-e78466d73767 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:02.981124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28945bb-999b-4d17-bf0d-afab51e86fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:02.982631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28945bb-999b-4d17-bf0d-afab51e86fa6 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:02.983362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28945bb-999b-4d17-bf0d-afab51e86fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:02.984115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28945bb-999b-4d17-bf0d-afab51e86fa6 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:02.985278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 44/91] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:02.985940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28945bb-999b-4d17-bf0d-afab51e86fa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:02.986154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c6718-1cce-4cb4-89c5-333765dd336b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:02.988996 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28945bb-999b-4d17-bf0d-afab51e86fa6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:03.000077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:03.066917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 48/92] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:01:02 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:03.073386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28945bb-999b-4d17-bf0d-afab51e86fa6 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:03.104105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c6718-1cce-4cb4-89c5-333765dd336b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:03.144354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031dd2-628f-47c8-b15e-83f8f72da9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:03.145037 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031dd2-628f-47c8-b15e-83f8f72da9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:03.145376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031dd2-628f-47c8-b15e-83f8f72da9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:03.145665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031dd2-628f-47c8-b15e-83f8f72da9f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:03.219408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:03.252052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11031dd2-628f-47c8-b15e-83f8f72da9f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:03.253594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11031dd2-628f-47c8-b15e-83f8f72da9f6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:03.270114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:03.324234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28945bb-999b-4d17-bf0d-afab51e86fa6 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:03.378697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f48abc-b74f-4969-9c6a-12edb78e944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:03.379979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f48abc-b74f-4969-9c6a-12edb78e944f None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:03.380485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f48abc-b74f-4969-9c6a-12edb78e944f None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:03.380961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f48abc-b74f-4969-9c6a-12edb78e944f None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:03.382612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f48abc-b74f-4969-9c6a-12edb78e944f None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:03.384402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f48abc-b74f-4969-9c6a-12edb78e944f None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:03.386452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 49/93] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:03 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:03.396151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f48abc-b74f-4969-9c6a-12edb78e944f None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:03.399005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 45/94] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:03.412975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031dd2-628f-47c8-b15e-83f8f72da9f6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:03.541645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f48abc-b74f-4969-9c6a-12edb78e944f None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:03.544213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031dd2-628f-47c8-b15e-83f8f72da9f6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:03.560726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:03.588885 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c3c3c-6e23-484a-9197-b4995b0477f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:03.589842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c3c3c-6e23-484a-9197-b4995b0477f9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:03.590172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c3c3c-6e23-484a-9197-b4995b0477f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:03.590451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c3c3c-6e23-484a-9197-b4995b0477f9 None admin] PATH_INFO: `/v3/projects/c5f18a016d1c4c46b72690a5a3f3ef60` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:03.591670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c3c3c-6e23-484a-9197-b4995b0477f9 None admin] RBAC: Authorizing `identity:get_project(project_id=c5f18a016d1c4c46b72690a5a3f3ef60)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:03.594529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c3c3c-6e23-484a-9197-b4995b0477f9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:03.596874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 46/95] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:03 2022] GET /identity/v3/projects/c5f18a016d1c4c46b72690a5a3f3ef60 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:03.604366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:03.605284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c3c3c-6e23-484a-9197-b4995b0477f9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:03.620546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e127bf8-2bef-42f8-8f50-0623ff181577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:03.621632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e127bf8-2bef-42f8-8f50-0623ff181577 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:03.622126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e127bf8-2bef-42f8-8f50-0623ff181577 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:03.622618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e127bf8-2bef-42f8-8f50-0623ff181577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:03.623557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e127bf8-2bef-42f8-8f50-0623ff181577 None admin] RBAC: Adding query filter params (role.id=c0027060d6364e5e9bd9c2cb5ad9788f, scope.project.id=54da9f11da824072acb54f348da7e461, user.id=4d880a26c97040af9607efb3a077fe5f) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:03.624463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e127bf8-2bef-42f8-8f50-0623ff181577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:03.625758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e127bf8-2bef-42f8-8f50-0623ff181577 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:03.635411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 50/96] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:03 2022] GET /identity/v3/role_assignments?user.id=4d880a26c97040af9607efb3a077fe5f&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=c0027060d6364e5e9bd9c2cb5ad9788f => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:03.738900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c3c3c-6e23-484a-9197-b4995b0477f9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:03.778399 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2658b-9976-4cea-9dd7-63c2a18c437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:03.779522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2658b-9976-4cea-9dd7-63c2a18c437d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:03.780034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2658b-9976-4cea-9dd7-63c2a18c437d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:03.780539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2658b-9976-4cea-9dd7-63c2a18c437d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:03.782170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2658b-9976-4cea-9dd7-63c2a18c437d None admin] RBAC: Adding query filter params (role.id=b35814b03f814680843c3aead86264f7, scope.project.id=c5f18a016d1c4c46b72690a5a3f3ef60, user.id=4d880a26c97040af9607efb3a077fe5f) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:03.782690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2658b-9976-4cea-9dd7-63c2a18c437d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:03.784486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2658b-9976-4cea-9dd7-63c2a18c437d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:03.791112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 47/97] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:03 2022] GET /identity/v3/role_assignments?user.id=4d880a26c97040af9607efb3a077fe5f&scope.project.id=c5f18a016d1c4c46b72690a5a3f3ef60&role.id=b35814b03f814680843c3aead86264f7 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:05.450338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3065-b654-4fde-ba1e-060983cec8d3 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:05.450869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3065-b654-4fde-ba1e-060983cec8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:05.451087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3065-b654-4fde-ba1e-060983cec8d3 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:05.452577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 51/98] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:05.459327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435d29f-9243-44d5-a52e-8dfe7714c89e None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:05.460330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088578b-417e-46d7-9786-a1b1098eeebd None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:05.461156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435d29f-9243-44d5-a52e-8dfe7714c89e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:05.461638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088578b-417e-46d7-9786-a1b1098eeebd None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:05.462105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435d29f-9243-44d5-a52e-8dfe7714c89e None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:05.462567 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088578b-417e-46d7-9786-a1b1098eeebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:05.464121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 52/99] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:05.470499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f764e18-39b6-4aef-8760-deeefae8ac2e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:05.471354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f764e18-39b6-4aef-8760-deeefae8ac2e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:05.472880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f764e18-39b6-4aef-8760-deeefae8ac2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:05.504134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f088578b-417e-46d7-9786-a1b1098eeebd None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:05.512837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f088578b-417e-46d7-9786-a1b1098eeebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:05.516842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9f764e18-39b6-4aef-8760-deeefae8ac2e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:05.520485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9f764e18-39b6-4aef-8760-deeefae8ac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:05.597041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:05.654040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 53/100] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:05.667884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 48/101] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:05.692138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f764e18-39b6-4aef-8760-deeefae8ac2e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:05.716584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088578b-417e-46d7-9786-a1b1098eeebd None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:05.880799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088578b-417e-46d7-9786-a1b1098eeebd None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:05.935979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f764e18-39b6-4aef-8760-deeefae8ac2e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:05.939733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858be7-645e-4e67-8eeb-252e0b577940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:05.940808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858be7-645e-4e67-8eeb-252e0b577940 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:05.941286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858be7-645e-4e67-8eeb-252e0b577940 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:05.941753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858be7-645e-4e67-8eeb-252e0b577940 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:05.963467 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1858be7-645e-4e67-8eeb-252e0b577940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:05.972940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-a1858be7-645e-4e67-8eeb-252e0b577940 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:05.977367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:05.978289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:05.979104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:05.986110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 49/102] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:05.991430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858be7-645e-4e67-8eeb-252e0b577940 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:06.011251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05209a2f-3321-44f9-b25a-9bc8e14842d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:06.012230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05209a2f-3321-44f9-b25a-9bc8e14842d4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:06.012584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05209a2f-3321-44f9-b25a-9bc8e14842d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:06.012877 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05209a2f-3321-44f9-b25a-9bc8e14842d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:06.041357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05209a2f-3321-44f9-b25a-9bc8e14842d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-05209a2f-3321-44f9-b25a-9bc8e14842d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:06.057842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:06.058750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:06.060130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 54/103] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:06.065027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:06.066169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05209a2f-3321-44f9-b25a-9bc8e14842d4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:06.233974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05209a2f-3321-44f9-b25a-9bc8e14842d4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:06.261889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858be7-645e-4e67-8eeb-252e0b577940 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:06.291559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7e514-08a1-4981-9beb-5606117c1bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:06.292288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e514-08a1-4981-9beb-5606117c1bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:06.292580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e514-08a1-4981-9beb-5606117c1bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:06.292864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e514-08a1-4981-9beb-5606117c1bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:06.293635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7e514-08a1-4981-9beb-5606117c1bb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:06.293950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7e514-08a1-4981-9beb-5606117c1bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:06.295379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7e514-08a1-4981-9beb-5606117c1bb1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:06.313172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 55/104] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:06.318672 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7e514-08a1-4981-9beb-5606117c1bb1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:06.353652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a500a-ddec-4e1a-8815-246c8f166634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:06.354362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a500a-ddec-4e1a-8815-246c8f166634 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:06.354656 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a500a-ddec-4e1a-8815-246c8f166634 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:06.354944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a500a-ddec-4e1a-8815-246c8f166634 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:06.355716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a500a-ddec-4e1a-8815-246c8f166634 None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:06.356060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a500a-ddec-4e1a-8815-246c8f166634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:06.357473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a500a-ddec-4e1a-8815-246c8f166634 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:06.376520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 50/105] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:06.382119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a500a-ddec-4e1a-8815-246c8f166634 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:06.398592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:06.480905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7e514-08a1-4981-9beb-5606117c1bb1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:06.573311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e079f7-f635-4aa5-a01c-b80619efb65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:06.574544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e079f7-f635-4aa5-a01c-b80619efb65d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:06.575030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e079f7-f635-4aa5-a01c-b80619efb65d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:06.575644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e079f7-f635-4aa5-a01c-b80619efb65d None admin] PATH_INFO: `/v3/users/ac80ec2c07774b5581b987e15cf3a2d3` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:06.577204 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e079f7-f635-4aa5-a01c-b80619efb65d None admin] RBAC: Authorizing `identity:get_user(user_id=ac80ec2c07774b5581b987e15cf3a2d3)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:06.581702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e079f7-f635-4aa5-a01c-b80619efb65d None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:06.581702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 56/106] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:06 2022] GET /identity/v3/users/ac80ec2c07774b5581b987e15cf3a2d3 => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:06.586942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e079f7-f635-4aa5-a01c-b80619efb65d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:06.589519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:06.606056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a500a-ddec-4e1a-8815-246c8f166634 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:06.712624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60129be4-ee4b-4224-84ce-8eb53598eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:06.713548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129be4-ee4b-4224-84ce-8eb53598eba4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:06.713935 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129be4-ee4b-4224-84ce-8eb53598eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:06.714195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129be4-ee4b-4224-84ce-8eb53598eba4 None admin] PATH_INFO: `/v3/users/4d880a26c97040af9607efb3a077fe5f` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:06.715456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60129be4-ee4b-4224-84ce-8eb53598eba4 None admin] RBAC: Authorizing `identity:get_user(user_id=4d880a26c97040af9607efb3a077fe5f)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:06.716972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60129be4-ee4b-4224-84ce-8eb53598eba4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:06.718624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 51/107] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:06 2022] GET /identity/v3/users/4d880a26c97040af9607efb3a077fe5f => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:06.725240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60129be4-ee4b-4224-84ce-8eb53598eba4 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:06.786691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e079f7-f635-4aa5-a01c-b80619efb65d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:06.801236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:06.872658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf4826-fdf1-4cb3-8477-c5ef80609e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:06.873562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf4826-fdf1-4cb3-8477-c5ef80609e2c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:06.873849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf4826-fdf1-4cb3-8477-c5ef80609e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:06.874129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf4826-fdf1-4cb3-8477-c5ef80609e2c None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:06.875509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf4826-fdf1-4cb3-8477-c5ef80609e2c None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:06.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf4826-fdf1-4cb3-8477-c5ef80609e2c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:06.878990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 57/108] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:06 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:06.884265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf4826-fdf1-4cb3-8477-c5ef80609e2c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:07.018782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf4826-fdf1-4cb3-8477-c5ef80609e2c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:07.081906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60129be4-ee4b-4224-84ce-8eb53598eba4 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:07.082118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb89df2-a0bb-4bd3-b183-062f998e4e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:07.082946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb89df2-a0bb-4bd3-b183-062f998e4e57 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.083237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb89df2-a0bb-4bd3-b183-062f998e4e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.083526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb89df2-a0bb-4bd3-b183-062f998e4e57 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461/users/ac80ec2c07774b5581b987e15cf3a2d3/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.085845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb89df2-a0bb-4bd3-b183-062f998e4e57 None admin] RBAC: Authorizing `identity:create_grant(project_id=54da9f11da824072acb54f348da7e461, user_id=ac80ec2c07774b5581b987e15cf3a2d3, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:07.087342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb89df2-a0bb-4bd3-b183-062f998e4e57 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:07.126621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187fbe3-7385-4204-b3a8-235758bd3064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:07.127435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187fbe3-7385-4204-b3a8-235758bd3064 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.127710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187fbe3-7385-4204-b3a8-235758bd3064 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.128023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187fbe3-7385-4204-b3a8-235758bd3064 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.129230 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187fbe3-7385-4204-b3a8-235758bd3064 None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:07.130703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187fbe3-7385-4204-b3a8-235758bd3064 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:07.132659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 52/109] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:06 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:07.133661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce4370-5722-498f-a1e9-7f054b91a802 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.135209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce4370-5722-498f-a1e9-7f054b91a802 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.135209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce4370-5722-498f-a1e9-7f054b91a802 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.135433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 53/110] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:07.136541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c09a65-9b8b-42ca-9014-14ffddf4605e None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.136835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c09a65-9b8b-42ca-9014-14ffddf4605e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.137120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c09a65-9b8b-42ca-9014-14ffddf4605e None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.138549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 54/111] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:07.143789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbff3d-9f79-4c24-b69c-acbab1d77331 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.144114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbff3d-9f79-4c24-b69c-acbab1d77331 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.144402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbff3d-9f79-4c24-b69c-acbab1d77331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.159433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 58/112] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:01:06 2022] PUT /identity/v3/projects/54da9f11da824072acb54f348da7e461/users/ac80ec2c07774b5581b987e15cf3a2d3/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:07.161230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e326e-c3bb-437b-bc08-50c119030903 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.161724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e326e-c3bb-437b-bc08-50c119030903 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.162201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e326e-c3bb-437b-bc08-50c119030903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.162507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-accbff3d-9f79-4c24-b69c-acbab1d77331 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:07.163898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-accbff3d-9f79-4c24-b69c-acbab1d77331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:07.186496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-069e326e-c3bb-437b-bc08-50c119030903 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:07.188887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-069e326e-c3bb-437b-bc08-50c119030903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:07.217808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:07.235856 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:07.275735 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 55/113] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:07.276799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbff3d-9f79-4c24-b69c-acbab1d77331 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:07.296088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 59/114] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:07.298779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf224f-3afc-4ae9-b02a-cbd0fd4c8aad None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.299181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf224f-3afc-4ae9-b02a-cbd0fd4c8aad None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.299583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf224f-3afc-4ae9-b02a-cbd0fd4c8aad None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.301366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 60/115] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:07.304529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac185f2-c17f-4c69-baff-ce73ce48fd25 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.304926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac185f2-c17f-4c69-baff-ce73ce48fd25 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.305369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac185f2-c17f-4c69-baff-ce73ce48fd25 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.310827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 61/116] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:07.310827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d0a5c-0c26-4833-a609-af251887713e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.310827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d0a5c-0c26-4833-a609-af251887713e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.310827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d0a5c-0c26-4833-a609-af251887713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.330773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-dc8d0a5c-0c26-4833-a609-af251887713e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:07.332430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-dc8d0a5c-0c26-4833-a609-af251887713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:07.402620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbff3d-9f79-4c24-b69c-acbab1d77331 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:07.415910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 62/117] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:07.415910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d0a5c-0c26-4833-a609-af251887713e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:07.450257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3c0db-7451-48eb-ba69-8817a1321cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:07.451154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3c0db-7451-48eb-ba69-8817a1321cf9 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.451437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3c0db-7451-48eb-ba69-8817a1321cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.451712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3c0db-7451-48eb-ba69-8817a1321cf9 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461/users/4d880a26c97040af9607efb3a077fe5f/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.453762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3c0db-7451-48eb-ba69-8817a1321cf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=54da9f11da824072acb54f348da7e461, user_id=4d880a26c97040af9607efb3a077fe5f, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:07.455290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3c0db-7451-48eb-ba69-8817a1321cf9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:07.516074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:07.522130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d0a5c-0c26-4833-a609-af251887713e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:07.554913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ef972-b8b7-4a81-b686-b0f0a2d5c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:07.555713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ef972-b8b7-4a81-b686-b0f0a2d5c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.556054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ef972-b8b7-4a81-b686-b0f0a2d5c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.556338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ef972-b8b7-4a81-b686-b0f0a2d5c8e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.557509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ef972-b8b7-4a81-b686-b0f0a2d5c8e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:07.558955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ef972-b8b7-4a81-b686-b0f0a2d5c8e8 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:07.560618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 63/118] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:07.565461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98716d-cb41-442f-a123-4b9c4f513070 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.565819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98716d-cb41-442f-a123-4b9c4f513070 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.566039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98716d-cb41-442f-a123-4b9c4f513070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.570001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 56/119] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:01:07 2022] PUT /identity/v3/projects/54da9f11da824072acb54f348da7e461/users/4d880a26c97040af9607efb3a077fe5f/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:07.573788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3c0db-7451-48eb-ba69-8817a1321cf9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:07.584514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-4a98716d-cb41-442f-a123-4b9c4f513070 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:07.586814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4a98716d-cb41-442f-a123-4b9c4f513070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:07.604792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:07.753564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3c0db-7451-48eb-ba69-8817a1321cf9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:07.761973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 64/120] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:07.762742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98716d-cb41-442f-a123-4b9c4f513070 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:07.800650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a40d7-a26f-4f6d-9452-64646c6f3369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:07.802060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a40d7-a26f-4f6d-9452-64646c6f3369 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.802576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a40d7-a26f-4f6d-9452-64646c6f3369 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.803060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a40d7-a26f-4f6d-9452-64646c6f3369 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.815849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a40d7-a26f-4f6d-9452-64646c6f3369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-e52a40d7-a26f-4f6d-9452-64646c6f3369 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:07.824793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:07.825688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 57/121] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:07.831508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a40d7-a26f-4f6d-9452-64646c6f3369 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:07.884889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:07.894791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98716d-cb41-442f-a123-4b9c4f513070 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:07.923148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:07.944364 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddc622-caa9-4115-a11e-c7aa1e24ccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:07.944718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a40d7-a26f-4f6d-9452-64646c6f3369 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:07.945644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddc622-caa9-4115-a11e-c7aa1e24ccbb None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.946070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddc622-caa9-4115-a11e-c7aa1e24ccbb None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.946640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddc622-caa9-4115-a11e-c7aa1e24ccbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.963219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddc622-caa9-4115-a11e-c7aa1e24ccbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-c5ddc622-caa9-4115-a11e-c7aa1e24ccbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:07.974008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:07.975035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:07.975919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 65/122] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:07.976545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddc622-caa9-4115-a11e-c7aa1e24ccbb None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:07.991111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7fd08-8c70-4ce7-93a1-a2b4c39fe4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:07.992425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7fd08-8c70-4ce7-93a1-a2b4c39fe4a1 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:07.992889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7fd08-8c70-4ce7-93a1-a2b4c39fe4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:07.993337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7fd08-8c70-4ce7-93a1-a2b4c39fe4a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:07.994607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7fd08-8c70-4ce7-93a1-a2b4c39fe4a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:07.996935 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7fd08-8c70-4ce7-93a1-a2b4c39fe4a1 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:08.082495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddc622-caa9-4115-a11e-c7aa1e24ccbb None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:08.114556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 58/123] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:01:07 2022] POST /identity/v3/projects => generated 302 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:08.116019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7fd08-8c70-4ce7-93a1-a2b4c39fe4a1 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:08.141915 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7384a-efec-422e-a4c9-30ca840b43cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:08.143212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7384a-efec-422e-a4c9-30ca840b43cb None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:08.143691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7384a-efec-422e-a4c9-30ca840b43cb None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:08.144184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7384a-efec-422e-a4c9-30ca840b43cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:08.168971 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7384a-efec-422e-a4c9-30ca840b43cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-bdd7384a-efec-422e-a4c9-30ca840b43cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:08.177825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:08.178733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:08.179568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:08.182090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 66/124] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:08.183463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7384a-efec-422e-a4c9-30ca840b43cb None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:08.202716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:08.340131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7fd08-8c70-4ce7-93a1-a2b4c39fe4a1 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:08.360968 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7384a-efec-422e-a4c9-30ca840b43cb None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:08.389705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:08.399745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f16156-00cd-442b-ad5d-208b45b3e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:08.408041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f16156-00cd-442b-ad5d-208b45b3e531 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:08.408041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f16156-00cd-442b-ad5d-208b45b3e531 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:08.408041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f16156-00cd-442b-ad5d-208b45b3e531 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:08.408041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f16156-00cd-442b-ad5d-208b45b3e531 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:08.408041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f16156-00cd-442b-ad5d-208b45b3e531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:08.408041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f16156-00cd-442b-ad5d-208b45b3e531 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:08.412638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 59/125] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:08.413236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f16156-00cd-442b-ad5d-208b45b3e531 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:08.428440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41feae-19f1-4c65-bb9d-2d08337d2da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:08.429532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41feae-19f1-4c65-bb9d-2d08337d2da3 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:08.430147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41feae-19f1-4c65-bb9d-2d08337d2da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:08.430619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41feae-19f1-4c65-bb9d-2d08337d2da3 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:08.431624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41feae-19f1-4c65-bb9d-2d08337d2da3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:08.432148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41feae-19f1-4c65-bb9d-2d08337d2da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:08.433800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41feae-19f1-4c65-bb9d-2d08337d2da3 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:08.443040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 67/126] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:08.444355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41feae-19f1-4c65-bb9d-2d08337d2da3 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:08.532505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:08.559894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41feae-19f1-4c65-bb9d-2d08337d2da3 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:08.642184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c4f10-6835-4ebd-8594-ac91f9f49bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:08.642184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c4f10-6835-4ebd-8594-ac91f9f49bee None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:08.642184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c4f10-6835-4ebd-8594-ac91f9f49bee None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:08.642184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c4f10-6835-4ebd-8594-ac91f9f49bee None admin] PATH_INFO: `/v3/users/4d880a26c97040af9607efb3a077fe5f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:08.642586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f16156-00cd-442b-ad5d-208b45b3e531 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:08.642995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c4f10-6835-4ebd-8594-ac91f9f49bee None admin] RBAC: Authorizing `identity:get_user(user_id=4d880a26c97040af9607efb3a077fe5f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:08.642995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c4f10-6835-4ebd-8594-ac91f9f49bee None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:08.642995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 68/127] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:08 2022] GET /identity/v3/users/4d880a26c97040af9607efb3a077fe5f => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:08.642995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c4f10-6835-4ebd-8594-ac91f9f49bee None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:08.701498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4004a-8920-4e64-a3c8-2ede38120eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:08.702545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4004a-8920-4e64-a3c8-2ede38120eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:08.703068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4004a-8920-4e64-a3c8-2ede38120eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:08.703547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4004a-8920-4e64-a3c8-2ede38120eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:08.704660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4004a-8920-4e64-a3c8-2ede38120eb5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:08.705177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4004a-8920-4e64-a3c8-2ede38120eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:08.706767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4004a-8920-4e64-a3c8-2ede38120eb5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:08.730725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 60/128] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:08.732122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4004a-8920-4e64-a3c8-2ede38120eb5 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:08.734793 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c4f10-6835-4ebd-8594-ac91f9f49bee None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:08.777434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50357f5-bbf1-4326-acfd-188d95f21c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:08.778326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50357f5-bbf1-4326-acfd-188d95f21c46 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:08.778617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50357f5-bbf1-4326-acfd-188d95f21c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:08.778901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50357f5-bbf1-4326-acfd-188d95f21c46 None admin] PATH_INFO: `/v3/users/4d880a26c97040af9607efb3a077fe5f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:08.784613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50357f5-bbf1-4326-acfd-188d95f21c46 None admin] RBAC: Authorizing `identity:get_user(user_id=4d880a26c97040af9607efb3a077fe5f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:08.786079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50357f5-bbf1-4326-acfd-188d95f21c46 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:08.789869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 69/129] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:08 2022] GET /identity/v3/users/4d880a26c97040af9607efb3a077fe5f => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:08.790452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50357f5-bbf1-4326-acfd-188d95f21c46 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:08.821995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:08.869527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:08.936495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50357f5-bbf1-4326-acfd-188d95f21c46 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:08.974835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa28a8-531a-4d61-9232-cc70350313f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:08.975729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa28a8-531a-4d61-9232-cc70350313f4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:08.976051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa28a8-531a-4d61-9232-cc70350313f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:08.976333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa28a8-531a-4d61-9232-cc70350313f4 None admin] PATH_INFO: `/v3/users/456600ab22ae4c0482669d810ba37ad8` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:08.994316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4004a-8920-4e64-a3c8-2ede38120eb5 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:08.994639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa28a8-531a-4d61-9232-cc70350313f4 None admin] RBAC: Authorizing `identity:get_user(user_id=456600ab22ae4c0482669d810ba37ad8)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:08.996425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa28a8-531a-4d61-9232-cc70350313f4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:08.998407 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 70/130] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:08 2022] GET /identity/v3/users/456600ab22ae4c0482669d810ba37ad8 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:08.998981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa28a8-531a-4d61-9232-cc70350313f4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:09.113120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae2cf1-2bd7-4a7e-8576-5014fe77b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:09.115902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae2cf1-2bd7-4a7e-8576-5014fe77b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:09.115902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae2cf1-2bd7-4a7e-8576-5014fe77b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:09.115902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae2cf1-2bd7-4a7e-8576-5014fe77b4d6 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:09.116591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:09.121121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae2cf1-2bd7-4a7e-8576-5014fe77b4d6 None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:09.122640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae2cf1-2bd7-4a7e-8576-5014fe77b4d6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:09.124804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 61/131] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:08 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:09.126206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae2cf1-2bd7-4a7e-8576-5014fe77b4d6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:09.151446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa28a8-531a-4d61-9232-cc70350313f4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:09.199256 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc02193-6c09-4b73-a62f-b9a9799a8004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:09.200153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02193-6c09-4b73-a62f-b9a9799a8004 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:09.203339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02193-6c09-4b73-a62f-b9a9799a8004 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:09.203627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc02193-6c09-4b73-a62f-b9a9799a8004 None admin] PATH_INFO: `/v3/projects/c5f18a016d1c4c46b72690a5a3f3ef60` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:09.217606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc02193-6c09-4b73-a62f-b9a9799a8004 None admin] RBAC: Authorizing `identity:get_project(project_id=c5f18a016d1c4c46b72690a5a3f3ef60)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:09.219145 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc02193-6c09-4b73-a62f-b9a9799a8004 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:09.221254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 71/132] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:08 2022] GET /identity/v3/projects/c5f18a016d1c4c46b72690a5a3f3ef60 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:09.221724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc02193-6c09-4b73-a62f-b9a9799a8004 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:09.463391 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae2cf1-2bd7-4a7e-8576-5014fe77b4d6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:09.532381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:09.547615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc02193-6c09-4b73-a62f-b9a9799a8004 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:09.558830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421c540-8972-4ba4-aaca-76fc3b3ae8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:09.561787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c540-8972-4ba4-aaca-76fc3b3ae8ee None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:09.565262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c540-8972-4ba4-aaca-76fc3b3ae8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:09.565765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c540-8972-4ba4-aaca-76fc3b3ae8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:09.666114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1de896-ea16-4d30-8ff0-5d2460df8ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:09.667148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1de896-ea16-4d30-8ff0-5d2460df8ab5 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:09.667447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1de896-ea16-4d30-8ff0-5d2460df8ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:09.667710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1de896-ea16-4d30-8ff0-5d2460df8ab5 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461/users/4d880a26c97040af9607efb3a077fe5f/roles/c0027060d6364e5e9bd9c2cb5ad9788f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:09.673982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421c540-8972-4ba4-aaca-76fc3b3ae8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:09.675623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421c540-8972-4ba4-aaca-76fc3b3ae8ee None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:09.681777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1de896-ea16-4d30-8ff0-5d2460df8ab5 None admin] RBAC: Authorizing `identity:create_grant(project_id=54da9f11da824072acb54f348da7e461, user_id=4d880a26c97040af9607efb3a077fe5f, role_id=c0027060d6364e5e9bd9c2cb5ad9788f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:09.683270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1de896-ea16-4d30-8ff0-5d2460df8ab5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:09.769636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:09.779914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 72/133] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:01:09 2022] PUT /identity/v3/projects/54da9f11da824072acb54f348da7e461/users/4d880a26c97040af9607efb3a077fe5f/roles/c0027060d6364e5e9bd9c2cb5ad9788f => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:09.779914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1de896-ea16-4d30-8ff0-5d2460df8ab5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:09.819403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 62/134] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:09.824581 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427610b9-7bb0-41ed-ade1-34cf547a0a01 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:09.824887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427610b9-7bb0-41ed-ade1-34cf547a0a01 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:09.825165 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427610b9-7bb0-41ed-ade1-34cf547a0a01 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:09.830284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 63/135] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:09.831227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427610b9-7bb0-41ed-ade1-34cf547a0a01 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:09.890256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:10.003322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1de896-ea16-4d30-8ff0-5d2460df8ab5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:10.053671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427610b9-7bb0-41ed-ade1-34cf547a0a01 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:10.068005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd14c-b0dd-4ffe-921d-5bb9e924d07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:10.069707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd14c-b0dd-4ffe-921d-5bb9e924d07b None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:10.070344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd14c-b0dd-4ffe-921d-5bb9e924d07b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:10.070914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd14c-b0dd-4ffe-921d-5bb9e924d07b None admin] PATH_INFO: `/v3/projects/c5f18a016d1c4c46b72690a5a3f3ef60/users/4d880a26c97040af9607efb3a077fe5f/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:10.073847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abd14c-b0dd-4ffe-921d-5bb9e924d07b None admin] RBAC: Authorizing `identity:create_grant(project_id=c5f18a016d1c4c46b72690a5a3f3ef60, user_id=4d880a26c97040af9607efb3a077fe5f, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:10.076048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abd14c-b0dd-4ffe-921d-5bb9e924d07b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:10.099108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578e4f5-b0c6-4421-ac02-81bad04ba5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:10.100134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578e4f5-b0c6-4421-ac02-81bad04ba5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:10.100502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578e4f5-b0c6-4421-ac02-81bad04ba5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:10.100835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578e4f5-b0c6-4421-ac02-81bad04ba5b0 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:10.107985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578e4f5-b0c6-4421-ac02-81bad04ba5b0 None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:10.107985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578e4f5-b0c6-4421-ac02-81bad04ba5b0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:10.107985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 64/136] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:09 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:10.107985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546e302-85f5-4277-913c-07b28471fded None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:10.107985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546e302-85f5-4277-913c-07b28471fded None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:10.107985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546e302-85f5-4277-913c-07b28471fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:10.129883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4546e302-85f5-4277-913c-07b28471fded None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:10.131082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4546e302-85f5-4277-913c-07b28471fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:10.184075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 73/137] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:01:09 2022] PUT /identity/v3/projects/c5f18a016d1c4c46b72690a5a3f3ef60/users/4d880a26c97040af9607efb3a077fe5f/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:10.185441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd14c-b0dd-4ffe-921d-5bb9e924d07b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:10.237811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 65/138] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:10.239963 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f095d-0ebb-484c-b02e-6854412fcfd8 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:10.240566 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f095d-0ebb-484c-b02e-6854412fcfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:10.241176 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f095d-0ebb-484c-b02e-6854412fcfd8 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:10.242925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 66/139] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:10.249629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5811b-7dc9-4497-a304-8501380e2458 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:10.250336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5811b-7dc9-4497-a304-8501380e2458 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:10.250822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5811b-7dc9-4497-a304-8501380e2458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:10.269612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7ef5811b-7dc9-4497-a304-8501380e2458 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:10.271227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7ef5811b-7dc9-4497-a304-8501380e2458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:10.291634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:10.352382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 67/140] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:10.357342 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5811b-7dc9-4497-a304-8501380e2458 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:10.362669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:10.485430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd14c-b0dd-4ffe-921d-5bb9e924d07b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:10.538471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c071df-4b68-4e68-bf16-4e9810753fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:10.542154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c071df-4b68-4e68-bf16-4e9810753fec None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:10.542154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c071df-4b68-4e68-bf16-4e9810753fec None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:10.542154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c071df-4b68-4e68-bf16-4e9810753fec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:10.542154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c071df-4b68-4e68-bf16-4e9810753fec None admin] RBAC: Adding query filter params (role.id=284d85c470f34ecd9485d00a62dffe68, scope.project.id=54da9f11da824072acb54f348da7e461, user.id=456600ab22ae4c0482669d810ba37ad8) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:10.542931 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c071df-4b68-4e68-bf16-4e9810753fec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:10.545036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c071df-4b68-4e68-bf16-4e9810753fec None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:10.551904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5811b-7dc9-4497-a304-8501380e2458 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:10.563047 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 74/141] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:10 2022] GET /identity/v3/role_assignments?user.id=456600ab22ae4c0482669d810ba37ad8&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=284d85c470f34ecd9485d00a62dffe68 => generated 259 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:10.565008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c071df-4b68-4e68-bf16-4e9810753fec None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:10.612511 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861acd15-855a-478a-9ec9-033827062198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:10.613543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861acd15-855a-478a-9ec9-033827062198 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:10.613837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861acd15-855a-478a-9ec9-033827062198 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:10.614115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861acd15-855a-478a-9ec9-033827062198 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:10.633076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861acd15-855a-478a-9ec9-033827062198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-861acd15-855a-478a-9ec9-033827062198 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:10.641066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:10.642007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:10.642765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:10.650175 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 68/142] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:10.658261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861acd15-855a-478a-9ec9-033827062198 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:10.686406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:10.765139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c071df-4b68-4e68-bf16-4e9810753fec None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:10.792051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:10.816726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2e0f9-e2fa-44d5-b71c-0f413b6968e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:10.818094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e0f9-e2fa-44d5-b71c-0f413b6968e7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:10.818594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e0f9-e2fa-44d5-b71c-0f413b6968e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:10.819066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e0f9-e2fa-44d5-b71c-0f413b6968e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:10.847437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2e0f9-e2fa-44d5-b71c-0f413b6968e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-2ae2e0f9-e2fa-44d5-b71c-0f413b6968e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:10.861609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:10.862569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:10.863360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:10.866183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 75/143] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:10.872309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2e0f9-e2fa-44d5-b71c-0f413b6968e7 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:10.899112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861acd15-855a-478a-9ec9-033827062198 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:10.956155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855cbdf-3f4f-4af1-8a42-d958ba74334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:10.956849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855cbdf-3f4f-4af1-8a42-d958ba74334e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:10.957132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855cbdf-3f4f-4af1-8a42-d958ba74334e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:10.957389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855cbdf-3f4f-4af1-8a42-d958ba74334e None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:10.958164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855cbdf-3f4f-4af1-8a42-d958ba74334e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:10.958475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855cbdf-3f4f-4af1-8a42-d958ba74334e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:10.960028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855cbdf-3f4f-4af1-8a42-d958ba74334e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:10.976930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 69/144] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:10.978321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdaaf7-6b30-4005-b465-bb5a6e2fdb28 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:10.978690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdaaf7-6b30-4005-b465-bb5a6e2fdb28 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:10.979004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdaaf7-6b30-4005-b465-bb5a6e2fdb28 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:10.980479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 70/145] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:10.984802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdaaf7-6b30-4005-b465-bb5a6e2fdb28 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:11.054784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2e0f9-e2fa-44d5-b71c-0f413b6968e7 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:11.066433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:11.092507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdaaf7-6b30-4005-b465-bb5a6e2fdb28 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:11.128209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abc9f4-d91f-4716-b524-66b111829ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:11.129023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abc9f4-d91f-4716-b524-66b111829ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:11.129310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abc9f4-d91f-4716-b524-66b111829ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:11.129591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abc9f4-d91f-4716-b524-66b111829ad4 None admin] PATH_INFO: `/v3/users/ac80ec2c07774b5581b987e15cf3a2d3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:11.130788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abc9f4-d91f-4716-b524-66b111829ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=ac80ec2c07774b5581b987e15cf3a2d3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:11.132261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abc9f4-d91f-4716-b524-66b111829ad4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:11.133907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 71/146] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:10 2022] GET /identity/v3/users/ac80ec2c07774b5581b987e15cf3a2d3 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:11.135183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c0db-ca12-4899-8bd0-b8b7cab33a8c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:11.135483 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c0db-ca12-4899-8bd0-b8b7cab33a8c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:11.135769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9c0db-ca12-4899-8bd0-b8b7cab33a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:11.152820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d8b9c0db-ca12-4899-8bd0-b8b7cab33a8c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:11.154204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d8b9c0db-ca12-4899-8bd0-b8b7cab33a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:11.160586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed33fd1-8bb6-4255-a9e7-449a38d1b2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:11.161282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33fd1-8bb6-4255-a9e7-449a38d1b2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:11.161579 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33fd1-8bb6-4255-a9e7-449a38d1b2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:11.161865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33fd1-8bb6-4255-a9e7-449a38d1b2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:11.162632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed33fd1-8bb6-4255-a9e7-449a38d1b2d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:11.162946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed33fd1-8bb6-4255-a9e7-449a38d1b2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:11.164386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed33fd1-8bb6-4255-a9e7-449a38d1b2d5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:11.183024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 76/147] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:11.183903 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed33fd1-8bb6-4255-a9e7-449a38d1b2d5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:11.228391 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 72/148] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:11.229272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9c0db-ca12-4899-8bd0-b8b7cab33a8c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:11.306268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:11.329461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:11.384863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9c0db-ca12-4899-8bd0-b8b7cab33a8c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:11.397354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed33fd1-8bb6-4255-a9e7-449a38d1b2d5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:11.447422 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b3db6-8df3-4848-9a95-f661a01fdeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:11.448336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b3db6-8df3-4848-9a95-f661a01fdeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:11.448622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b3db6-8df3-4848-9a95-f661a01fdeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:11.448895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b3db6-8df3-4848-9a95-f661a01fdeb6 None admin] PATH_INFO: `/v3/users/4d880a26c97040af9607efb3a077fe5f` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:11.450093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b3db6-8df3-4848-9a95-f661a01fdeb6 None admin] RBAC: Authorizing `identity:get_user(user_id=4d880a26c97040af9607efb3a077fe5f)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:11.451563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b3db6-8df3-4848-9a95-f661a01fdeb6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:11.453894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 73/149] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:11 2022] GET /identity/v3/users/4d880a26c97040af9607efb3a077fe5f => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:11.454653 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b3db6-8df3-4848-9a95-f661a01fdeb6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:11.472618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f72a4c-293a-40cc-bb13-6d4251972615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:11.473285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f72a4c-293a-40cc-bb13-6d4251972615 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:11.473574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f72a4c-293a-40cc-bb13-6d4251972615 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:11.473858 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f72a4c-293a-40cc-bb13-6d4251972615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:11.609786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f72a4c-293a-40cc-bb13-6d4251972615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:11.611391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f72a4c-293a-40cc-bb13-6d4251972615 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:11.635922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b3db6-8df3-4848-9a95-f661a01fdeb6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:11.703376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:11.703729 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bdeaa-3e76-4483-b60b-dc71e59c2038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:11.704572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bdeaa-3e76-4483-b60b-dc71e59c2038 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:11.704856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bdeaa-3e76-4483-b60b-dc71e59c2038 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:11.705127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bdeaa-3e76-4483-b60b-dc71e59c2038 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:11.706410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bdeaa-3e76-4483-b60b-dc71e59c2038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:11.707908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bdeaa-3e76-4483-b60b-dc71e59c2038 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:11.709746 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 74/150] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:11.710379 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bdeaa-3e76-4483-b60b-dc71e59c2038 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:11.743816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:11.804508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 77/151] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:11.805697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f72a4c-293a-40cc-bb13-6d4251972615 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:11.931521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bdeaa-3e76-4483-b60b-dc71e59c2038 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:11.970955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f72a4c-293a-40cc-bb13-6d4251972615 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:12.014942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf366a1f-a869-4c1b-9247-3bffb05bacfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:12.016190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf366a1f-a869-4c1b-9247-3bffb05bacfb None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:12.016481 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf366a1f-a869-4c1b-9247-3bffb05bacfb None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:12.016759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf366a1f-a869-4c1b-9247-3bffb05bacfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:12.017977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f765d-119e-4d2a-b31c-df10d989486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:12.018654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f765d-119e-4d2a-b31c-df10d989486f None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:12.018935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f765d-119e-4d2a-b31c-df10d989486f None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:12.019210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f765d-119e-4d2a-b31c-df10d989486f None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:12.019956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f765d-119e-4d2a-b31c-df10d989486f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:12.021419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f765d-119e-4d2a-b31c-df10d989486f None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:12.099209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf366a1f-a869-4c1b-9247-3bffb05bacfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:12.100802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf366a1f-a869-4c1b-9247-3bffb05bacfb None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:12.131845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:12.138757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 78/152] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:01:11 2022] POST /identity/v3/users => generated 283 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:12.139417 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f765d-119e-4d2a-b31c-df10d989486f None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:12.147637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:12.298881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 75/153] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:12.304651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf366a1f-a869-4c1b-9247-3bffb05bacfb None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:12.429926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f765d-119e-4d2a-b31c-df10d989486f None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:12.470134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf366a1f-a869-4c1b-9247-3bffb05bacfb None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:12.480808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:12.510529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263013f4-111a-40d9-9e61-8a5974b28888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:12.513610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263013f4-111a-40d9-9e61-8a5974b28888 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:12.514662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263013f4-111a-40d9-9e61-8a5974b28888 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:12.516275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263013f4-111a-40d9-9e61-8a5974b28888 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:12.518702 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263013f4-111a-40d9-9e61-8a5974b28888 None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:12.523028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263013f4-111a-40d9-9e61-8a5974b28888 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:12.525528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 76/154] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:12 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:12.530580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211314-840c-4fc8-a0be-544e57b9c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:12.531720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263013f4-111a-40d9-9e61-8a5974b28888 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:12.532922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211314-840c-4fc8-a0be-544e57b9c368 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:12.533800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211314-840c-4fc8-a0be-544e57b9c368 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:12.534667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211314-840c-4fc8-a0be-544e57b9c368 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:12.538333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75211314-840c-4fc8-a0be-544e57b9c368 None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:12.540040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75211314-840c-4fc8-a0be-544e57b9c368 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:12.548478 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 79/155] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:12 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:12.555037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211314-840c-4fc8-a0be-544e57b9c368 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:12.673915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263013f4-111a-40d9-9e61-8a5974b28888 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:12.722130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea1f2b-a695-48c5-867f-1c16335f5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:12.723603 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea1f2b-a695-48c5-867f-1c16335f5c40 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:12.723937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea1f2b-a695-48c5-867f-1c16335f5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:12.724224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea1f2b-a695-48c5-867f-1c16335f5c40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:12.725156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea1f2b-a695-48c5-867f-1c16335f5c40 None admin] RBAC: Adding query filter params (role.id=b35814b03f814680843c3aead86264f7, scope.project.id=54da9f11da824072acb54f348da7e461, user.id=4d880a26c97040af9607efb3a077fe5f) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:12.725413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea1f2b-a695-48c5-867f-1c16335f5c40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:12.726900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea1f2b-a695-48c5-867f-1c16335f5c40 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:12.733991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:12.737998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 77/156] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:12 2022] GET /identity/v3/role_assignments?user.id=4d880a26c97040af9607efb3a077fe5f&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=b35814b03f814680843c3aead86264f7 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:12.739687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760ba5-9497-44e3-8d60-f7f688c98d8b None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:12.740348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760ba5-9497-44e3-8d60-f7f688c98d8b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:12.740827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760ba5-9497-44e3-8d60-f7f688c98d8b None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:12.742512 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 78/157] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:12.754381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e865ac5-2df0-4f49-a100-171afec741fc None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:12.755692 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e865ac5-2df0-4f49-a100-171afec741fc None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:12.756220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e865ac5-2df0-4f49-a100-171afec741fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:12.785843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-9e865ac5-2df0-4f49-a100-171afec741fc None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:12.787081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9e865ac5-2df0-4f49-a100-171afec741fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:12.811833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211314-840c-4fc8-a0be-544e57b9c368 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:12.867285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b9d27-7f4e-4853-9dff-8e20e50f02c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:12.867988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9d27-7f4e-4853-9dff-8e20e50f02c6 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:12.868539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9d27-7f4e-4853-9dff-8e20e50f02c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:12.868815 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9d27-7f4e-4853-9dff-8e20e50f02c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:12.869711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b9d27-7f4e-4853-9dff-8e20e50f02c6 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=54da9f11da824072acb54f348da7e461, user.id=ac80ec2c07774b5581b987e15cf3a2d3) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:12.870022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b9d27-7f4e-4853-9dff-8e20e50f02c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:12.871491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b9d27-7f4e-4853-9dff-8e20e50f02c6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:12.885119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 80/158] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:12 2022] GET /identity/v3/role_assignments?user.id=ac80ec2c07774b5581b987e15cf3a2d3&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=31c5600d1f984a04827cf0052fc61678 => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:12.886842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:12.947302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 79/159] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:12.988270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b9d27-7f4e-4853-9dff-8e20e50f02c6 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:13.113158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b9d27-7f4e-4853-9dff-8e20e50f02c6 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:13.146010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:13.155509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152347-b3d9-4e36-82de-1bafb3f63d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:13.156942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152347-b3d9-4e36-82de-1bafb3f63d3a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.163453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152347-b3d9-4e36-82de-1bafb3f63d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.163453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152347-b3d9-4e36-82de-1bafb3f63d3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.169156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152347-b3d9-4e36-82de-1bafb3f63d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:13.173717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede9e24-faae-49ab-9705-54c84422ad14 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.174002 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede9e24-faae-49ab-9705-54c84422ad14 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.174276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede9e24-faae-49ab-9705-54c84422ad14 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.175682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 80/160] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:13.181452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707abc9-1b35-49e6-be38-c390c04c61c5 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.181738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707abc9-1b35-49e6-be38-c390c04c61c5 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.182015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707abc9-1b35-49e6-be38-c390c04c61c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-e3152347-b3d9-4e36-82de-1bafb3f63d3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:13.182511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:13.183418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:13.185038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 81/161] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:13.190541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152347-b3d9-4e36-82de-1bafb3f63d3a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:13.208820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4707abc9-1b35-49e6-be38-c390c04c61c5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:13.210804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4707abc9-1b35-49e6-be38-c390c04c61c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:13.340556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 81/162] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:13.370891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707abc9-1b35-49e6-be38-c390c04c61c5 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:13.396621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152347-b3d9-4e36-82de-1bafb3f63d3a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:13.468345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cfb44-18b6-468b-bc7b-bb304a60d468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:13.469753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cfb44-18b6-468b-bc7b-bb304a60d468 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.469753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cfb44-18b6-468b-bc7b-bb304a60d468 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.470162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cfb44-18b6-468b-bc7b-bb304a60d468 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.471054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cfb44-18b6-468b-bc7b-bb304a60d468 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:13.471415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cfb44-18b6-468b-bc7b-bb304a60d468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:13.475677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cfb44-18b6-468b-bc7b-bb304a60d468 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:13.482385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 82/163] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:13.489149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cfb44-18b6-468b-bc7b-bb304a60d468 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:13.521031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:13.524249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707abc9-1b35-49e6-be38-c390c04c61c5 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:13.553506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:13.561619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c464724-86c2-4ddf-82c4-ff2794d930b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:13.562465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464724-86c2-4ddf-82c4-ff2794d930b6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.572162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464724-86c2-4ddf-82c4-ff2794d930b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.572162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464724-86c2-4ddf-82c4-ff2794d930b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.574060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c464724-86c2-4ddf-82c4-ff2794d930b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-5c464724-86c2-4ddf-82c4-ff2794d930b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:13.583592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:13.584767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:13.585630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 82/164] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:13.592389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c464724-86c2-4ddf-82c4-ff2794d930b6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:13.611121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cfb44-18b6-468b-bc7b-bb304a60d468 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:13.650162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520c7ca-e16f-4a5b-aae4-d76815e60c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:13.651505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520c7ca-e16f-4a5b-aae4-d76815e60c6e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.652017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520c7ca-e16f-4a5b-aae4-d76815e60c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.652508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520c7ca-e16f-4a5b-aae4-d76815e60c6e None admin] PATH_INFO: `/v3/users/4d880a26c97040af9607efb3a077fe5f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.654046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520c7ca-e16f-4a5b-aae4-d76815e60c6e None admin] RBAC: Authorizing `identity:get_user(user_id=4d880a26c97040af9607efb3a077fe5f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:13.655830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520c7ca-e16f-4a5b-aae4-d76815e60c6e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:13.658507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 83/165] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:13 2022] GET /identity/v3/users/4d880a26c97040af9607efb3a077fe5f => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:13.664130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520c7ca-e16f-4a5b-aae4-d76815e60c6e None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:13.704066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c464724-86c2-4ddf-82c4-ff2794d930b6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:13.739773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05eaf8-fa58-42fd-874e-c8ccd4c12062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:13.740559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05eaf8-fa58-42fd-874e-c8ccd4c12062 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.740765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05eaf8-fa58-42fd-874e-c8ccd4c12062 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.741136 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05eaf8-fa58-42fd-874e-c8ccd4c12062 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.741800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05eaf8-fa58-42fd-874e-c8ccd4c12062 None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:13.742112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05eaf8-fa58-42fd-874e-c8ccd4c12062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:13.743926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05eaf8-fa58-42fd-874e-c8ccd4c12062 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:13.753337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 83/166] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:13.754690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5804b-1918-4108-b9ac-107d8f185752 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.754985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5804b-1918-4108-b9ac-107d8f185752 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.755264 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5804b-1918-4108-b9ac-107d8f185752 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.761489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 84/167] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:13.762287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5804b-1918-4108-b9ac-107d8f185752 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:13.789977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:13.799888 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520c7ca-e16f-4a5b-aae4-d76815e60c6e None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:13.871867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:13.876465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5804b-1918-4108-b9ac-107d8f185752 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:13.910208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d838f0-f5d0-4fcf-846d-89d0195172d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:13.910838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d838f0-f5d0-4fcf-846d-89d0195172d6 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.911143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d838f0-f5d0-4fcf-846d-89d0195172d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.911529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d838f0-f5d0-4fcf-846d-89d0195172d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.920838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a8883-29c0-4407-a986-b2b62149be70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:13.921882 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a8883-29c0-4407-a986-b2b62149be70 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.922162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a8883-29c0-4407-a986-b2b62149be70 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.922435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a8883-29c0-4407-a986-b2b62149be70 None admin] PATH_INFO: `/v3/users/4d880a26c97040af9607efb3a077fe5f` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.923736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a8883-29c0-4407-a986-b2b62149be70 None admin] RBAC: Authorizing `identity:get_user(user_id=4d880a26c97040af9607efb3a077fe5f)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:13.925351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a8883-29c0-4407-a986-b2b62149be70 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:13.927353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 85/168] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:13 2022] GET /identity/v3/users/4d880a26c97040af9607efb3a077fe5f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:13.928444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145900c-d7a0-4a13-aaa6-0b1cf8a2b2e6 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:13.928733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145900c-d7a0-4a13-aaa6-0b1cf8a2b2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:13.929009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145900c-d7a0-4a13-aaa6-0b1cf8a2b2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:13.971823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7145900c-d7a0-4a13-aaa6-0b1cf8a2b2e6 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:13.973757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7145900c-d7a0-4a13-aaa6-0b1cf8a2b2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:14.029059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d838f0-f5d0-4fcf-846d-89d0195172d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:14.032712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d838f0-f5d0-4fcf-846d-89d0195172d6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:14.083779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 86/169] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:14.085012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145900c-d7a0-4a13-aaa6-0b1cf8a2b2e6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:14.107576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:14.189645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145900c-d7a0-4a13-aaa6-0b1cf8a2b2e6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:14.225329 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a54487-4d78-4fcc-8302-419c01b62ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:14.226291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a54487-4d78-4fcc-8302-419c01b62ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:14.226761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a54487-4d78-4fcc-8302-419c01b62ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:14.227218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a54487-4d78-4fcc-8302-419c01b62ac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:14.301591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a54487-4d78-4fcc-8302-419c01b62ac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:14.303498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a54487-4d78-4fcc-8302-419c01b62ac8 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:14.338942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 84/170] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:01:14.339129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:14.339470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d838f0-f5d0-4fcf-846d-89d0195172d6 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:14.404275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:14.458130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 87/171] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:14.458753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a54487-4d78-4fcc-8302-419c01b62ac8 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:14.554865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d838f0-f5d0-4fcf-846d-89d0195172d6 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:14.613363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696e530-afc1-4d62-ad4e-2daaf6fa8426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:14.614516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696e530-afc1-4d62-ad4e-2daaf6fa8426 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:14.615028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696e530-afc1-4d62-ad4e-2daaf6fa8426 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:14.615600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696e530-afc1-4d62-ad4e-2daaf6fa8426 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:14.640278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696e530-afc1-4d62-ad4e-2daaf6fa8426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-0696e530-afc1-4d62-ad4e-2daaf6fa8426 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:14.648663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:14.649532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:14.650411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:14.662394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 85/172] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:14.663541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696e530-afc1-4d62-ad4e-2daaf6fa8426 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:14.670319 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a54487-4d78-4fcc-8302-419c01b62ac8 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:14.701455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:14.726463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa3c4f-5931-4a21-a554-7bee4bc1d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:14.727668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa3c4f-5931-4a21-a554-7bee4bc1d90c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:14.729595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa3c4f-5931-4a21-a554-7bee4bc1d90c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:14.730087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa3c4f-5931-4a21-a554-7bee4bc1d90c None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:14.732177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa3c4f-5931-4a21-a554-7bee4bc1d90c None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:14.734446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa3c4f-5931-4a21-a554-7bee4bc1d90c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:14.736574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 88/173] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:14 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:14.739728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa3c4f-5931-4a21-a554-7bee4bc1d90c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:14.840295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:14.865421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696e530-afc1-4d62-ad4e-2daaf6fa8426 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:14.891406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa3c4f-5931-4a21-a554-7bee4bc1d90c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:14.926578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79ccd-4c18-498c-acfb-035fdde351cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:14.927677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79ccd-4c18-498c-acfb-035fdde351cf None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:14.928216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79ccd-4c18-498c-acfb-035fdde351cf None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:14.928843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79ccd-4c18-498c-acfb-035fdde351cf None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:14.929794 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79ccd-4c18-498c-acfb-035fdde351cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:14.930307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79ccd-4c18-498c-acfb-035fdde351cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:14.931915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79ccd-4c18-498c-acfb-035fdde351cf None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:14.938100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36887eaa-2588-4f34-9980-e799b9e98bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:14.938959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36887eaa-2588-4f34-9980-e799b9e98bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:14.939243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36887eaa-2588-4f34-9980-e799b9e98bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:14.939520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36887eaa-2588-4f34-9980-e799b9e98bc1 None admin] PATH_INFO: `/v3/projects/c5f18a016d1c4c46b72690a5a3f3ef60` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:14.942602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 89/174] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:14.943824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79ccd-4c18-498c-acfb-035fdde351cf None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:14.944650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36887eaa-2588-4f34-9980-e799b9e98bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=c5f18a016d1c4c46b72690a5a3f3ef60)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:14.946152 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36887eaa-2588-4f34-9980-e799b9e98bc1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:14.947916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 86/175] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:14 2022] GET /identity/v3/projects/c5f18a016d1c4c46b72690a5a3f3ef60 => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:14.948683 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36887eaa-2588-4f34-9980-e799b9e98bc1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:15.026841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:15.116479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79ccd-4c18-498c-acfb-035fdde351cf None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:15.133904 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36887eaa-2588-4f34-9980-e799b9e98bc1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:15.189441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b569b-7515-477b-8c95-c1116e9fdeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:15.190484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b569b-7515-477b-8c95-c1116e9fdeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:15.190965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b569b-7515-477b-8c95-c1116e9fdeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:15.191434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b569b-7515-477b-8c95-c1116e9fdeb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:15.192649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b569b-7515-477b-8c95-c1116e9fdeb9 None admin] RBAC: Adding query filter params (role.id=c0027060d6364e5e9bd9c2cb5ad9788f, scope.project.id=54da9f11da824072acb54f348da7e461, user.id=4d880a26c97040af9607efb3a077fe5f) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:15.193157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b569b-7515-477b-8c95-c1116e9fdeb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:15.195014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b569b-7515-477b-8c95-c1116e9fdeb9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:15.204069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2181e99-1bde-41c6-ac02-1d41fb497244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:15.205260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2181e99-1bde-41c6-ac02-1d41fb497244 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:15.205536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 90/176] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:14 2022] GET /identity/v3/role_assignments?user.id=4d880a26c97040af9607efb3a077fe5f&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=c0027060d6364e5e9bd9c2cb5ad9788f => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:15.206084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2181e99-1bde-41c6-ac02-1d41fb497244 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:15.206409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b569b-7515-477b-8c95-c1116e9fdeb9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:15.206825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2181e99-1bde-41c6-ac02-1d41fb497244 None admin] PATH_INFO: `/v3/users/456600ab22ae4c0482669d810ba37ad8` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:15.217055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2181e99-1bde-41c6-ac02-1d41fb497244 None admin] RBAC: Authorizing `identity:get_user(user_id=456600ab22ae4c0482669d810ba37ad8)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:15.219107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2181e99-1bde-41c6-ac02-1d41fb497244 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:15.221262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 87/177] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:14 2022] GET /identity/v3/users/456600ab22ae4c0482669d810ba37ad8 => generated 289 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:15.226829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2181e99-1bde-41c6-ac02-1d41fb497244 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:15.284376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:15.421018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b569b-7515-477b-8c95-c1116e9fdeb9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:15.443310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:15.479933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c46b4c-397a-46db-b05d-85d3b8f9671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:15.481990 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46b4c-397a-46db-b05d-85d3b8f9671b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:15.482666 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46b4c-397a-46db-b05d-85d3b8f9671b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:15.483897 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c46b4c-397a-46db-b05d-85d3b8f9671b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:15.485640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c46b4c-397a-46db-b05d-85d3b8f9671b None admin] RBAC: Adding query filter params (role.id=b35814b03f814680843c3aead86264f7, scope.project.id=c5f18a016d1c4c46b72690a5a3f3ef60, user.id=4d880a26c97040af9607efb3a077fe5f) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:15.486342 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c46b4c-397a-46db-b05d-85d3b8f9671b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:15.488946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c46b4c-397a-46db-b05d-85d3b8f9671b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:15.500181 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 91/178] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:15 2022] GET /identity/v3/role_assignments?user.id=4d880a26c97040af9607efb3a077fe5f&scope.project.id=c5f18a016d1c4c46b72690a5a3f3ef60&role.id=b35814b03f814680843c3aead86264f7 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:15.502287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2181e99-1bde-41c6-ac02-1d41fb497244 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:15.553648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d7e7f-1e9a-43cf-b225-79ee07cf36ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:15.553648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7e7f-1e9a-43cf-b225-79ee07cf36ea None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:15.553648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7e7f-1e9a-43cf-b225-79ee07cf36ea None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:15.553648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7e7f-1e9a-43cf-b225-79ee07cf36ea None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:15.554021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d7e7f-1e9a-43cf-b225-79ee07cf36ea None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:15.554021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d7e7f-1e9a-43cf-b225-79ee07cf36ea None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:15.554021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 88/179] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:15 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:15.557488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c46b4c-397a-46db-b05d-85d3b8f9671b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:15.605163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38afd8f-ada6-4711-85f1-35e23894b27e None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:15.605818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38afd8f-ada6-4711-85f1-35e23894b27e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:15.606095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38afd8f-ada6-4711-85f1-35e23894b27e None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:15.607677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 89/180] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:01:15.613967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6954b-e7df-44a2-bd6c-47adf4168056 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:15.614261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6954b-e7df-44a2-bd6c-47adf4168056 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:15.614520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6954b-e7df-44a2-bd6c-47adf4168056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:15.639356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-3ef6954b-e7df-44a2-bd6c-47adf4168056 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:15.641216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3ef6954b-e7df-44a2-bd6c-47adf4168056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:15.750788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c46b4c-397a-46db-b05d-85d3b8f9671b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:15.795198 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a35b89-78a4-45aa-b67c-3cc89af1c47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:15.796157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a35b89-78a4-45aa-b67c-3cc89af1c47d None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:15.796974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a35b89-78a4-45aa-b67c-3cc89af1c47d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:15.797247 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a35b89-78a4-45aa-b67c-3cc89af1c47d None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461/users/456600ab22ae4c0482669d810ba37ad8/roles/284d85c470f34ecd9485d00a62dffe68` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:15.799533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a35b89-78a4-45aa-b67c-3cc89af1c47d None admin] RBAC: Authorizing `identity:create_grant(project_id=54da9f11da824072acb54f348da7e461, user_id=456600ab22ae4c0482669d810ba37ad8, role_id=284d85c470f34ecd9485d00a62dffe68)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:15.801596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a35b89-78a4-45aa-b67c-3cc89af1c47d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:15.809023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 90/181] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:15.834107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6954b-e7df-44a2-bd6c-47adf4168056 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:15.854521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:15.873258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 92/182] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:01:15 2022] PUT /identity/v3/projects/54da9f11da824072acb54f348da7e461/users/456600ab22ae4c0482669d810ba37ad8/roles/284d85c470f34ecd9485d00a62dffe68 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:15.959608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c6ea2-7240-44ca-a132-d50a0e41b27e None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:15.960223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c6ea2-7240-44ca-a132-d50a0e41b27e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:15.960223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c6ea2-7240-44ca-a132-d50a0e41b27e None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:15.961739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 93/183] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:01:15.969189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb9f1f-ecbd-4797-a3b4-8ebcc738521c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:15.969486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb9f1f-ecbd-4797-a3b4-8ebcc738521c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:15.969767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb9f1f-ecbd-4797-a3b4-8ebcc738521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:15.975753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6954b-e7df-44a2-bd6c-47adf4168056 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:15.994590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-1dbb9f1f-ecbd-4797-a3b4-8ebcc738521c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:15.996703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1dbb9f1f-ecbd-4797-a3b4-8ebcc738521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:16.018104 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de505e73-d4dc-4ad7-b3cf-0142b3ed46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:16.019206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505e73-d4dc-4ad7-b3cf-0142b3ed46fe None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.019660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505e73-d4dc-4ad7-b3cf-0142b3ed46fe None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.020140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505e73-d4dc-4ad7-b3cf-0142b3ed46fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.031439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:16.034448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de505e73-d4dc-4ad7-b3cf-0142b3ed46fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-de505e73-d4dc-4ad7-b3cf-0142b3ed46fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:16.042902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:16.049236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:16.050128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 91/184] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:16.052251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de505e73-d4dc-4ad7-b3cf-0142b3ed46fe None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:16.092011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 94/185] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:16.120091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb9f1f-ecbd-4797-a3b4-8ebcc738521c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:16.158553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:16.184738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de505e73-d4dc-4ad7-b3cf-0142b3ed46fe None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:16.225251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b031db1-d2ac-48e7-9498-0b0742f6b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:16.225936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031db1-d2ac-48e7-9498-0b0742f6b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.226266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031db1-d2ac-48e7-9498-0b0742f6b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.226546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031db1-d2ac-48e7-9498-0b0742f6b3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.227291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b031db1-d2ac-48e7-9498-0b0742f6b3a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:16.227595 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b031db1-d2ac-48e7-9498-0b0742f6b3a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:16.229143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b031db1-d2ac-48e7-9498-0b0742f6b3a6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:16.239636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 92/186] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:16.245323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b031db1-d2ac-48e7-9498-0b0742f6b3a6 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:16.259431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb9f1f-ecbd-4797-a3b4-8ebcc738521c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:16.297446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2eecb-c04e-4576-98fc-759ebe5e8459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:16.298271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2eecb-c04e-4576-98fc-759ebe5e8459 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.298550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2eecb-c04e-4576-98fc-759ebe5e8459 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.298817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2eecb-c04e-4576-98fc-759ebe5e8459 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.309551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2eecb-c04e-4576-98fc-759ebe5e8459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-83d2eecb-c04e-4576-98fc-759ebe5e8459 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:16.318392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:16.319272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:16.320221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 95/187] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:16.325629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfc9ae-74b3-47b7-bb97-f187f6629746 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.325921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfc9ae-74b3-47b7-bb97-f187f6629746 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.326204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfc9ae-74b3-47b7-bb97-f187f6629746 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.327565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 96/188] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:16.328916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfc9ae-74b3-47b7-bb97-f187f6629746 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:16.358118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:16.365769 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b031db1-d2ac-48e7-9498-0b0742f6b3a6 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:16.410393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017653b-3c34-4a45-abc4-d1f5d815fa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:16.411282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017653b-3c34-4a45-abc4-d1f5d815fa67 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.411854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017653b-3c34-4a45-abc4-d1f5d815fa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.411854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017653b-3c34-4a45-abc4-d1f5d815fa67 None admin] PATH_INFO: `/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.420600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:16.428127 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017653b-3c34-4a45-abc4-d1f5d815fa67 None admin] RBAC: Authorizing `identity:get_user(user_id=1e13a9d3d47a4efbbd69b0a24213ffe1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:16.429622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017653b-3c34-4a45-abc4-d1f5d815fa67 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:16.431361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 93/189] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:16 2022] GET /identity/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:16.436098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff9eb-b057-4c74-933d-2cba787603ae None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.436098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff9eb-b057-4c74-933d-2cba787603ae None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.436098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff9eb-b057-4c74-933d-2cba787603ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.442752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfc9ae-74b3-47b7-bb97-f187f6629746 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:16.449958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-398ff9eb-b057-4c74-933d-2cba787603ae None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:16.451191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-398ff9eb-b057-4c74-933d-2cba787603ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:16.480120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954097-c3c4-4614-8649-e1522579216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:16.480798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954097-c3c4-4614-8649-e1522579216c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.481084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954097-c3c4-4614-8649-e1522579216c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.482995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954097-c3c4-4614-8649-e1522579216c None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.482995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954097-c3c4-4614-8649-e1522579216c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:16.482995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954097-c3c4-4614-8649-e1522579216c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:16.483812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954097-c3c4-4614-8649-e1522579216c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:16.497980 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 97/190] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:16.497980 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954097-c3c4-4614-8649-e1522579216c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:16.537617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 94/191] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:16.538312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ff9eb-b057-4c74-933d-2cba787603ae None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:16.597826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:16.607820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954097-c3c4-4614-8649-e1522579216c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:16.644614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20dcb0-da79-435b-ad51-948218cb4449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:16.645193 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20dcb0-da79-435b-ad51-948218cb4449 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.645486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20dcb0-da79-435b-ad51-948218cb4449 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20dcb0-da79-435b-ad51-948218cb4449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.658502 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ff9eb-b057-4c74-933d-2cba787603ae None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:16.687687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:16.696976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3fb65-7312-49fe-8060-35e8d0f90e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:16.697924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3fb65-7312-49fe-8060-35e8d0f90e64 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.698175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3fb65-7312-49fe-8060-35e8d0f90e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.700800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3fb65-7312-49fe-8060-35e8d0f90e64 None admin] PATH_INFO: `/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.700800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3fb65-7312-49fe-8060-35e8d0f90e64 None admin] RBAC: Authorizing `identity:get_user(user_id=1e13a9d3d47a4efbbd69b0a24213ffe1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:16.701155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3fb65-7312-49fe-8060-35e8d0f90e64 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:16.702989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 95/192] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:16 2022] GET /identity/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:16.708184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3fb65-7312-49fe-8060-35e8d0f90e64 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:16.719923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20dcb0-da79-435b-ad51-948218cb4449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:16.721556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20dcb0-da79-435b-ad51-948218cb4449 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:16.816447 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:16.818056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3fb65-7312-49fe-8060-35e8d0f90e64 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:16.828324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 98/193] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:16.829245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20dcb0-da79-435b-ad51-948218cb4449 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:16.855987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa03ab1-0d85-458a-a57d-35f7d839f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:16.857418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa03ab1-0d85-458a-a57d-35f7d839f647 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.857840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa03ab1-0d85-458a-a57d-35f7d839f647 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.858120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa03ab1-0d85-458a-a57d-35f7d839f647 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.859962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa03ab1-0d85-458a-a57d-35f7d839f647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:16.861509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa03ab1-0d85-458a-a57d-35f7d839f647 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:16.868439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 96/194] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:16.869323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa03ab1-0d85-458a-a57d-35f7d839f647 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:16.939595 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:16.941420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20dcb0-da79-435b-ad51-948218cb4449 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:16.977270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16622bdd-10bc-4fbf-85a6-8a7f04765f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:16.978249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16622bdd-10bc-4fbf-85a6-8a7f04765f7c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:16.978356 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16622bdd-10bc-4fbf-85a6-8a7f04765f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:16.978674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16622bdd-10bc-4fbf-85a6-8a7f04765f7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:16.980945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa03ab1-0d85-458a-a57d-35f7d839f647 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:17.016998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61946b-c84a-4b53-b960-6cb2421a9df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:17.018684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61946b-c84a-4b53-b960-6cb2421a9df4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:17.018977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61946b-c84a-4b53-b960-6cb2421a9df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:17.019256 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61946b-c84a-4b53-b960-6cb2421a9df4 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:17.020496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61946b-c84a-4b53-b960-6cb2421a9df4 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:17.022405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61946b-c84a-4b53-b960-6cb2421a9df4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:17.024747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 97/195] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:16 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:17.028745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61946b-c84a-4b53-b960-6cb2421a9df4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:17.050693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:17.063604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16622bdd-10bc-4fbf-85a6-8a7f04765f7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:17.069941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16622bdd-10bc-4fbf-85a6-8a7f04765f7c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:17.143601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61946b-c84a-4b53-b960-6cb2421a9df4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:17.179538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 99/196] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:17.180215 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:17.180459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16622bdd-10bc-4fbf-85a6-8a7f04765f7c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:17.188614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79241e20-e8cc-4903-a447-ca3aebbc2b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:17.195843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79241e20-e8cc-4903-a447-ca3aebbc2b00 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:17.195843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79241e20-e8cc-4903-a447-ca3aebbc2b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:17.195843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79241e20-e8cc-4903-a447-ca3aebbc2b00 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:17.195843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79241e20-e8cc-4903-a447-ca3aebbc2b00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:17.195843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79241e20-e8cc-4903-a447-ca3aebbc2b00 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:17.275940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:17.285917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16622bdd-10bc-4fbf-85a6-8a7f04765f7c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:17.310836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 98/197] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:01:17 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:17.312133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79241e20-e8cc-4903-a447-ca3aebbc2b00 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:17.335524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843b0a2-9a02-48d5-8886-c9e15ba1d2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:17.336260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b0a2-9a02-48d5-8886-c9e15ba1d2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:17.336542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b0a2-9a02-48d5-8886-c9e15ba1d2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:17.336817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b0a2-9a02-48d5-8886-c9e15ba1d2a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:17.337960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843b0a2-9a02-48d5-8886-c9e15ba1d2a5 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=d287700518a644f8bd9772318b8e8e0e, user.id=1e13a9d3d47a4efbbd69b0a24213ffe1) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:17.338334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843b0a2-9a02-48d5-8886-c9e15ba1d2a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:17.340144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843b0a2-9a02-48d5-8886-c9e15ba1d2a5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:17.348112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 100/198] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:17 2022] GET /identity/v3/role_assignments?user.id=1e13a9d3d47a4efbbd69b0a24213ffe1&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=31c5600d1f984a04827cf0052fc61678 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:17.449222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79241e20-e8cc-4903-a447-ca3aebbc2b00 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:17.491286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7841c-3e15-492d-bf4a-82813041eb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:17.492215 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7841c-3e15-492d-bf4a-82813041eb4b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:17.492501 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7841c-3e15-492d-bf4a-82813041eb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:17.492777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7841c-3e15-492d-bf4a-82813041eb4b None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:17.494426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7841c-3e15-492d-bf4a-82813041eb4b None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:17.496056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7841c-3e15-492d-bf4a-82813041eb4b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:17.498016 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 99/199] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:17 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:17.504311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843b0a2-9a02-48d5-8886-c9e15ba1d2a5 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:17.623491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843b0a2-9a02-48d5-8886-c9e15ba1d2a5 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:17.662930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e6aac-ece9-4cab-a75e-74e197860997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:17.664199 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6aac-ece9-4cab-a75e-74e197860997 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:17.664199 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6aac-ece9-4cab-a75e-74e197860997 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:17.664392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6aac-ece9-4cab-a75e-74e197860997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:17.665284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6aac-ece9-4cab-a75e-74e197860997 None admin] RBAC: Adding query filter params (role.id=c0027060d6364e5e9bd9c2cb5ad9788f, scope.project.id=d287700518a644f8bd9772318b8e8e0e, user.id=1e13a9d3d47a4efbbd69b0a24213ffe1) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:17.666769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6aac-ece9-4cab-a75e-74e197860997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:17.667599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6aac-ece9-4cab-a75e-74e197860997 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:17.676029 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 101/200] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:17 2022] GET /identity/v3/role_assignments?user.id=1e13a9d3d47a4efbbd69b0a24213ffe1&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=c0027060d6364e5e9bd9c2cb5ad9788f => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:18.388585 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0d7b-4d8c-4cdb-9da6-a14be2c8ed04 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:18.389106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0d7b-4d8c-4cdb-9da6-a14be2c8ed04 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:18.389189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0d7b-4d8c-4cdb-9da6-a14be2c8ed04 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:18.390805 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 100/201] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:18.396550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec1412-2410-4e49-8a6a-3d733cec669f None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:18.396935 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec1412-2410-4e49-8a6a-3d733cec669f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:18.397110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec1412-2410-4e49-8a6a-3d733cec669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:18.417983 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-29ec1412-2410-4e49-8a6a-3d733cec669f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:18.419177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-29ec1412-2410-4e49-8a6a-3d733cec669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:18.439722 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:18.520912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 102/202] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:18.549799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0d7b-4d8c-4cdb-9da6-a14be2c8ed04 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:18.721499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:18.784606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0d7b-4d8c-4cdb-9da6-a14be2c8ed04 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:18.836841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76601209-05b0-4b7d-bdcd-e8b95ee225d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:18.837646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76601209-05b0-4b7d-bdcd-e8b95ee225d4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:18.837932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76601209-05b0-4b7d-bdcd-e8b95ee225d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:18.838211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76601209-05b0-4b7d-bdcd-e8b95ee225d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:18.856725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76601209-05b0-4b7d-bdcd-e8b95ee225d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-76601209-05b0-4b7d-bdcd-e8b95ee225d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:18.865021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:18.865887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:18.866762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 101/203] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:18.873700 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec1412-2410-4e49-8a6a-3d733cec669f None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:19.012102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec1412-2410-4e49-8a6a-3d733cec669f None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:19.058592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b428189-8fee-432d-88ec-a1e5c4c82d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:19.059282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428189-8fee-432d-88ec-a1e5c4c82d2a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:19.059566 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428189-8fee-432d-88ec-a1e5c4c82d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:19.059840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428189-8fee-432d-88ec-a1e5c4c82d2a None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:19.060620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b428189-8fee-432d-88ec-a1e5c4c82d2a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:19.060926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b428189-8fee-432d-88ec-a1e5c4c82d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:19.062882 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b428189-8fee-432d-88ec-a1e5c4c82d2a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:19.071854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 103/204] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:19.077392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76601209-05b0-4b7d-bdcd-e8b95ee225d4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:19.217716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76601209-05b0-4b7d-bdcd-e8b95ee225d4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:19.234723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:19.258198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faedca-7f5e-452c-8253-e23e103716d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:19.259084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faedca-7f5e-452c-8253-e23e103716d0 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:19.259370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faedca-7f5e-452c-8253-e23e103716d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:19.259651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faedca-7f5e-452c-8253-e23e103716d0 None admin] PATH_INFO: `/v3/users/456600ab22ae4c0482669d810ba37ad8` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:19.260883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faedca-7f5e-452c-8253-e23e103716d0 None admin] RBAC: Authorizing `identity:get_user(user_id=456600ab22ae4c0482669d810ba37ad8)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:19.262379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faedca-7f5e-452c-8253-e23e103716d0 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:19.263968 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 102/205] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:19 2022] GET /identity/v3/users/456600ab22ae4c0482669d810ba37ad8 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:19.270490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b428189-8fee-432d-88ec-a1e5c4c82d2a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:19.288766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:19.403756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b428189-8fee-432d-88ec-a1e5c4c82d2a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:19.438455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da5581-970a-4a86-af3c-71ce0047b205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:19.439121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da5581-970a-4a86-af3c-71ce0047b205 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:19.439406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da5581-970a-4a86-af3c-71ce0047b205 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:19.439683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da5581-970a-4a86-af3c-71ce0047b205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:19.534482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da5581-970a-4a86-af3c-71ce0047b205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:19.535902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da5581-970a-4a86-af3c-71ce0047b205 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:19.547968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:19.654188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 104/206] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:19.659846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faedca-7f5e-452c-8253-e23e103716d0 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:19.806479 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faedca-7f5e-452c-8253-e23e103716d0 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:19.855988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d08e7-4476-4f6b-804b-d5eb8a0627ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:19.856893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d08e7-4476-4f6b-804b-d5eb8a0627ba None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:19.857178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d08e7-4476-4f6b-804b-d5eb8a0627ba None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:19.857456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d08e7-4476-4f6b-804b-d5eb8a0627ba None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:19.859284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d08e7-4476-4f6b-804b-d5eb8a0627ba None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:19.860834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d08e7-4476-4f6b-804b-d5eb8a0627ba None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:19.862644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 103/207] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:19 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:19.869045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da5581-970a-4a86-af3c-71ce0047b205 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:19.892516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050425-f132-432a-b0e5-4f87ea24b390 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:19.892841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050425-f132-432a-b0e5-4f87ea24b390 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:19.893076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050425-f132-432a-b0e5-4f87ea24b390 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:19.894749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 104/208] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:19.902396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabacd4-5b80-4bdf-86dc-7242c7a75877 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:19.902685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabacd4-5b80-4bdf-86dc-7242c7a75877 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:19.902959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabacd4-5b80-4bdf-86dc-7242c7a75877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:19.934640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0eabacd4-5b80-4bdf-86dc-7242c7a75877 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:19.935852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0eabacd4-5b80-4bdf-86dc-7242c7a75877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:20.031763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:20.069261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da5581-970a-4a86-af3c-71ce0047b205 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:20.072498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 105/209] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:20.096276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:20.108498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97be1f1-2a21-4a79-8519-7223ef3f4fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:20.109996 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabacd4-5b80-4bdf-86dc-7242c7a75877 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:20.113526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be1f1-2a21-4a79-8519-7223ef3f4fdc None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.118424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be1f1-2a21-4a79-8519-7223ef3f4fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.136358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97be1f1-2a21-4a79-8519-7223ef3f4fdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.136358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97be1f1-2a21-4a79-8519-7223ef3f4fdc None admin] RBAC: Adding query filter params (role.id=284d85c470f34ecd9485d00a62dffe68, scope.project.id=54da9f11da824072acb54f348da7e461, user.id=456600ab22ae4c0482669d810ba37ad8) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:20.136358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97be1f1-2a21-4a79-8519-7223ef3f4fdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:20.136358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97be1f1-2a21-4a79-8519-7223ef3f4fdc None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:20.136358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 105/210] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:19 2022] GET /identity/v3/role_assignments?user.id=456600ab22ae4c0482669d810ba37ad8&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=284d85c470f34ecd9485d00a62dffe68 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:20.155847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2351862-23f3-4dad-9faa-935c9ee990d0 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.156162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2351862-23f3-4dad-9faa-935c9ee990d0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.156857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2351862-23f3-4dad-9faa-935c9ee990d0 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.159008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 106/211] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:01:20.168115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a671f69-cdff-407a-b69f-c5567849f56f None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.168640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a671f69-cdff-407a-b69f-c5567849f56f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.169086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a671f69-cdff-407a-b69f-c5567849f56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.188832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7a671f69-cdff-407a-b69f-c5567849f56f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:20.191317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7a671f69-cdff-407a-b69f-c5567849f56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:20.275824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 107/212] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:20.277756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac34a9a-c966-4cc9-a0a1-94e053ff0ed0 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.278202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac34a9a-c966-4cc9-a0a1-94e053ff0ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.278703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac34a9a-c966-4cc9-a0a1-94e053ff0ed0 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.280377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 108/213] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:20.286941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabacd4-5b80-4bdf-86dc-7242c7a75877 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:20.287461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9aa6d-bc57-4ac5-b752-1112ad0c43ba None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.287757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9aa6d-bc57-4ac5-b752-1112ad0c43ba None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.288057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9aa6d-bc57-4ac5-b752-1112ad0c43ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.315186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0cb9aa6d-bc57-4ac5-b752-1112ad0c43ba None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:20.316414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0cb9aa6d-bc57-4ac5-b752-1112ad0c43ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:20.326424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f41c5-2f33-4f51-91d3-f55a45ee8e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:20.328069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f41c5-2f33-4f51-91d3-f55a45ee8e4a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.328497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f41c5-2f33-4f51-91d3-f55a45ee8e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.328911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f41c5-2f33-4f51-91d3-f55a45ee8e4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.345811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f41c5-2f33-4f51-91d3-f55a45ee8e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-2f0f41c5-2f33-4f51-91d3-f55a45ee8e4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:20.357940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:20.359132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:20.360137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:20.362409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 106/214] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:20.363410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f41c5-2f33-4f51-91d3-f55a45ee8e4a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:20.408780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 109/215] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:20.415892 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9aa6d-bc57-4ac5-b752-1112ad0c43ba None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:20.421022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:20.453052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:20.526911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f41c5-2f33-4f51-91d3-f55a45ee8e4a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:20.563505 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9aa6d-bc57-4ac5-b752-1112ad0c43ba None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:20.572173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bc3e1-7d20-4b32-8830-c06126925ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:20.573048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bc3e1-7d20-4b32-8830-c06126925ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.573333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bc3e1-7d20-4b32-8830-c06126925ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.573604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bc3e1-7d20-4b32-8830-c06126925ee7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.585884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bc3e1-7d20-4b32-8830-c06126925ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-f81bc3e1-7d20-4b32-8830-c06126925ee7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:20.598784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:20.599693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:20.600529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 107/216] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:20.601194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bc3e1-7d20-4b32-8830-c06126925ee7 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:20.611667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4862bd-68f2-4159-bc71-991b7a24bbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:20.612495 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4862bd-68f2-4159-bc71-991b7a24bbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.612784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4862bd-68f2-4159-bc71-991b7a24bbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.613060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4862bd-68f2-4159-bc71-991b7a24bbb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.614193 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4862bd-68f2-4159-bc71-991b7a24bbb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:20.614510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4862bd-68f2-4159-bc71-991b7a24bbb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:20.616254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4862bd-68f2-4159-bc71-991b7a24bbb2 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:20.625452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 110/217] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:20.626122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4862bd-68f2-4159-bc71-991b7a24bbb2 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:20.714300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:20.717377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bc3e1-7d20-4b32-8830-c06126925ee7 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:20.726056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:20.732187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4862bd-68f2-4159-bc71-991b7a24bbb2 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:20.753786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943047c7-0222-4d07-bf9e-a57cdeacf342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:20.754616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943047c7-0222-4d07-bf9e-a57cdeacf342 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.754907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943047c7-0222-4d07-bf9e-a57cdeacf342 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.755184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943047c7-0222-4d07-bf9e-a57cdeacf342 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.766924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943047c7-0222-4d07-bf9e-a57cdeacf342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:20.772509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8832edd-7c20-4594-b220-144ef5aedb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:20.773246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8832edd-7c20-4594-b220-144ef5aedb8a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.773535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8832edd-7c20-4594-b220-144ef5aedb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.773848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8832edd-7c20-4594-b220-144ef5aedb8a None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.774619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8832edd-7c20-4594-b220-144ef5aedb8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-943047c7-0222-4d07-bf9e-a57cdeacf342 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:20.774927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:20.775754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:20.777019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:20.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8832edd-7c20-4594-b220-144ef5aedb8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:20.778094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 108/218] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:20.778159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8832edd-7c20-4594-b220-144ef5aedb8a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:20.781319 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943047c7-0222-4d07-bf9e-a57cdeacf342 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:20.790831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 111/219] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:20.791676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8832edd-7c20-4594-b220-144ef5aedb8a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:20.892293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943047c7-0222-4d07-bf9e-a57cdeacf342 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:20.898943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8832edd-7c20-4594-b220-144ef5aedb8a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:20.925783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165efc1-d810-40a0-8f0d-01d7e320da18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:20.926751 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165efc1-d810-40a0-8f0d-01d7e320da18 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.927030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165efc1-d810-40a0-8f0d-01d7e320da18 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.927308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165efc1-d810-40a0-8f0d-01d7e320da18 None admin] PATH_INFO: `/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.928512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165efc1-d810-40a0-8f0d-01d7e320da18 None admin] RBAC: Authorizing `identity:get_user(user_id=1e13a9d3d47a4efbbd69b0a24213ffe1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:20.929946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165efc1-d810-40a0-8f0d-01d7e320da18 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:20.931765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 109/220] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:20 2022] GET /identity/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:20.932488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165efc1-d810-40a0-8f0d-01d7e320da18 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:20.938088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529da96b-a26d-4659-8034-4ec59bf70e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:20.938769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529da96b-a26d-4659-8034-4ec59bf70e9d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:20.939053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529da96b-a26d-4659-8034-4ec59bf70e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:20.939323 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529da96b-a26d-4659-8034-4ec59bf70e9d None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:20.940112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529da96b-a26d-4659-8034-4ec59bf70e9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:20.940416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529da96b-a26d-4659-8034-4ec59bf70e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:20.941802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529da96b-a26d-4659-8034-4ec59bf70e9d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:20.957602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 112/221] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:20.957602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529da96b-a26d-4659-8034-4ec59bf70e9d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:20.969065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:20.979545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:21.045437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165efc1-d810-40a0-8f0d-01d7e320da18 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:21.057826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529da96b-a26d-4659-8034-4ec59bf70e9d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:21.079847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59661b-22f8-4373-be55-002df5c21562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:21.080758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59661b-22f8-4373-be55-002df5c21562 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.081044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59661b-22f8-4373-be55-002df5c21562 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.081316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59661b-22f8-4373-be55-002df5c21562 None admin] PATH_INFO: `/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.082495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59661b-22f8-4373-be55-002df5c21562 None admin] RBAC: Authorizing `identity:get_user(user_id=1e13a9d3d47a4efbbd69b0a24213ffe1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:21.083951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59661b-22f8-4373-be55-002df5c21562 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:21.085561 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 110/222] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:20 2022] GET /identity/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:21.086504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59661b-22f8-4373-be55-002df5c21562 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:21.091716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197bc76-6fca-46a6-8924-711c3fa813dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:21.092609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197bc76-6fca-46a6-8924-711c3fa813dc None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.092896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197bc76-6fca-46a6-8924-711c3fa813dc None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.093729 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197bc76-6fca-46a6-8924-711c3fa813dc None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.094923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197bc76-6fca-46a6-8924-711c3fa813dc None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:21.096409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197bc76-6fca-46a6-8924-711c3fa813dc None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:21.098093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 113/223] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:20 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:21.101237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48ed5-42ed-41ed-9aab-784c46ff6e60 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.101525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48ed5-42ed-41ed-9aab-784c46ff6e60 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.101804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48ed5-42ed-41ed-9aab-784c46ff6e60 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.103098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 114/224] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:21.103802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d48ed5-42ed-41ed-9aab-784c46ff6e60 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:21.180758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:21.186273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59661b-22f8-4373-be55-002df5c21562 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:21.191865 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:21.204485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d48ed5-42ed-41ed-9aab-784c46ff6e60 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:21.217958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69c9b5-22e4-45ed-925d-f0962aeebbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:21.218862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69c9b5-22e4-45ed-925d-f0962aeebbee None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.219145 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69c9b5-22e4-45ed-925d-f0962aeebbee None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.219418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69c9b5-22e4-45ed-925d-f0962aeebbee None admin] PATH_INFO: `/v3/users/7eaac49c3b9640ecbb24abe4677b754a` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.233186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69c9b5-22e4-45ed-925d-f0962aeebbee None admin] RBAC: Authorizing `identity:get_user(user_id=7eaac49c3b9640ecbb24abe4677b754a)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:21.235254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69c9b5-22e4-45ed-925d-f0962aeebbee None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:21.236862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd44f9f-fa44-4ac5-a6ab-70034053f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:21.236979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 111/225] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:21 2022] GET /identity/v3/users/7eaac49c3b9640ecbb24abe4677b754a => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:21.237730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44f9f-fa44-4ac5-a6ab-70034053f8eb None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.238013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44f9f-fa44-4ac5-a6ab-70034053f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.238295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44f9f-fa44-4ac5-a6ab-70034053f8eb None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.239462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd44f9f-fa44-4ac5-a6ab-70034053f8eb None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:21.240724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69c9b5-22e4-45ed-925d-f0962aeebbee None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:21.240976 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd44f9f-fa44-4ac5-a6ab-70034053f8eb None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:21.243197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 115/226] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:21 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:21.245253 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6454c3-2745-4c08-a2d6-ba140cbc01ac None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.245713 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6454c3-2745-4c08-a2d6-ba140cbc01ac None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.245995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6454c3-2745-4c08-a2d6-ba140cbc01ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.263644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-2b6454c3-2745-4c08-a2d6-ba140cbc01ac None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:21.265548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2b6454c3-2745-4c08-a2d6-ba140cbc01ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:21.331411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 116/227] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:21.336235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6454c3-2745-4c08-a2d6-ba140cbc01ac None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:21.342627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69c9b5-22e4-45ed-925d-f0962aeebbee None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:21.377080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0f473-39d0-4689-b92a-f25134bf3352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:21.377992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0f473-39d0-4689-b92a-f25134bf3352 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.378274 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0f473-39d0-4689-b92a-f25134bf3352 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.378550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0f473-39d0-4689-b92a-f25134bf3352 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e/users/1e13a9d3d47a4efbbd69b0a24213ffe1/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.380568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0f473-39d0-4689-b92a-f25134bf3352 None admin] RBAC: Authorizing `identity:create_grant(project_id=d287700518a644f8bd9772318b8e8e0e, user_id=1e13a9d3d47a4efbbd69b0a24213ffe1, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:21.382037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0f473-39d0-4689-b92a-f25134bf3352 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:21.426188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:21.430118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 112/228] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:01:21 2022] PUT /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e/users/1e13a9d3d47a4efbbd69b0a24213ffe1/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:21.430982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0f473-39d0-4689-b92a-f25134bf3352 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:21.445319 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6454c3-2745-4c08-a2d6-ba140cbc01ac None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:21.447483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:21.484824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227cf30-1642-492f-83f4-da483d3ca770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:21.485446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227cf30-1642-492f-83f4-da483d3ca770 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.485732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227cf30-1642-492f-83f4-da483d3ca770 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.486013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227cf30-1642-492f-83f4-da483d3ca770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.555761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0f473-39d0-4689-b92a-f25134bf3352 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:21.562803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227cf30-1642-492f-83f4-da483d3ca770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:21.564370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227cf30-1642-492f-83f4-da483d3ca770 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:21.594928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d2864-5e38-429f-81ac-b1f4878d80e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:21.595854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2864-5e38-429f-81ac-b1f4878d80e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.596168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2864-5e38-429f-81ac-b1f4878d80e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.596451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2864-5e38-429f-81ac-b1f4878d80e7 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e/users/1e13a9d3d47a4efbbd69b0a24213ffe1/roles/c0027060d6364e5e9bd9c2cb5ad9788f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.598760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d2864-5e38-429f-81ac-b1f4878d80e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d287700518a644f8bd9772318b8e8e0e, user_id=1e13a9d3d47a4efbbd69b0a24213ffe1, role_id=c0027060d6364e5e9bd9c2cb5ad9788f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:21.600396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d2864-5e38-429f-81ac-b1f4878d80e7 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:21.658850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:21.674267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 117/229] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:21.675132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227cf30-1642-492f-83f4-da483d3ca770 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:21.716032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 113/230] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:01:21 2022] PUT /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e/users/1e13a9d3d47a4efbbd69b0a24213ffe1/roles/c0027060d6364e5e9bd9c2cb5ad9788f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:21.717572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d2864-5e38-429f-81ac-b1f4878d80e7 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:21.806045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227cf30-1642-492f-83f4-da483d3ca770 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:21.807719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:21.850064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d2864-5e38-429f-81ac-b1f4878d80e7 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:21.856100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342060e-7cef-478c-b4e4-229eaf87977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:21.856940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342060e-7cef-478c-b4e4-229eaf87977d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.857223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342060e-7cef-478c-b4e4-229eaf87977d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.857498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342060e-7cef-478c-b4e4-229eaf87977d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.859521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342060e-7cef-478c-b4e4-229eaf87977d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:21.861438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342060e-7cef-478c-b4e4-229eaf87977d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:21.863438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 118/231] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:21.869364 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342060e-7cef-478c-b4e4-229eaf87977d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:21.893085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445414-4ab3-4fd9-8b8b-20120fbd44d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:21.894319 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445414-4ab3-4fd9-8b8b-20120fbd44d1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:21.894743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445414-4ab3-4fd9-8b8b-20120fbd44d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:21.895284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445414-4ab3-4fd9-8b8b-20120fbd44d1 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:21.896836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445414-4ab3-4fd9-8b8b-20120fbd44d1 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:21.898627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445414-4ab3-4fd9-8b8b-20120fbd44d1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:21.900668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 114/232] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:21 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:21.908974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445414-4ab3-4fd9-8b8b-20120fbd44d1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:21.943681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:21.998991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342060e-7cef-478c-b4e4-229eaf87977d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:22.021681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445414-4ab3-4fd9-8b8b-20120fbd44d1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:22.042430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a4811-497a-4e43-ad7e-ee589b620c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:22.043141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a4811-497a-4e43-ad7e-ee589b620c20 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:22.043698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a4811-497a-4e43-ad7e-ee589b620c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:22.044015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a4811-497a-4e43-ad7e-ee589b620c20 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:22.044732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a4811-497a-4e43-ad7e-ee589b620c20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:22.046725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a4811-497a-4e43-ad7e-ee589b620c20 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:22.061227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362d491-ecc5-4cbe-a4af-9a62c9057968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:22.062876 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362d491-ecc5-4cbe-a4af-9a62c9057968 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:22.063304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362d491-ecc5-4cbe-a4af-9a62c9057968 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:22.063582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362d491-ecc5-4cbe-a4af-9a62c9057968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:22.064853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362d491-ecc5-4cbe-a4af-9a62c9057968 None admin] RBAC: Adding query filter params (role.id=b35814b03f814680843c3aead86264f7, scope.project.id=d287700518a644f8bd9772318b8e8e0e, user.id=7eaac49c3b9640ecbb24abe4677b754a) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:22.065164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362d491-ecc5-4cbe-a4af-9a62c9057968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:22.067062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362d491-ecc5-4cbe-a4af-9a62c9057968 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:22.073626 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 115/233] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:21 2022] GET /identity/v3/role_assignments?user.id=7eaac49c3b9640ecbb24abe4677b754a&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=b35814b03f814680843c3aead86264f7 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:22.180986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 119/234] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:01:21 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:24.079021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3f92-25f3-4689-b0de-86f637ad0086 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:24.079597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3f92-25f3-4689-b0de-86f637ad0086 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:24.079597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3f92-25f3-4689-b0de-86f637ad0086 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:24.080979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 116/235] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:24.086347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa672e2-7abd-4611-83c3-40f64d244993 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:24.086741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa672e2-7abd-4611-83c3-40f64d244993 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:24.086947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa672e2-7abd-4611-83c3-40f64d244993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:24.104925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ffa672e2-7abd-4611-83c3-40f64d244993 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:24.106117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ffa672e2-7abd-4611-83c3-40f64d244993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:24.176278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 120/236] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:24.200138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff3f92-25f3-4689-b0de-86f637ad0086 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:24.209809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:24.327902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff3f92-25f3-4689-b0de-86f637ad0086 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:24.364763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821091e2-a41c-4ef3-aa2c-fb9b1e6f0bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:24.365572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821091e2-a41c-4ef3-aa2c-fb9b1e6f0bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:24.365856 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821091e2-a41c-4ef3-aa2c-fb9b1e6f0bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:24.366133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821091e2-a41c-4ef3-aa2c-fb9b1e6f0bb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:24.380699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821091e2-a41c-4ef3-aa2c-fb9b1e6f0bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-821091e2-a41c-4ef3-aa2c-fb9b1e6f0bb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:24.388472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:24.390692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:24.392676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:24.395927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 117/237] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:24.399913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa672e2-7abd-4611-83c3-40f64d244993 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:24.412253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac342d6-8ce0-481c-acf1-0f3440119e92 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:24.412538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac342d6-8ce0-481c-acf1-0f3440119e92 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:24.412816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac342d6-8ce0-481c-acf1-0f3440119e92 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:24.414256 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 118/238] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:01:24.419571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632076f-f035-41eb-bf85-7c1f5b45f22b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:24.419857 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632076f-f035-41eb-bf85-7c1f5b45f22b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:24.420159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632076f-f035-41eb-bf85-7c1f5b45f22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:24.455610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a632076f-f035-41eb-bf85-7c1f5b45f22b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:24.456853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a632076f-f035-41eb-bf85-7c1f5b45f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:24.471180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:24.582018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:24.591568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa672e2-7abd-4611-83c3-40f64d244993 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:24.610223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 119/239] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:24.644014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833dcc5-1756-4081-944e-267e2d38edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:24.644627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833dcc5-1756-4081-944e-267e2d38edb3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:24.644907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833dcc5-1756-4081-944e-267e2d38edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:24.645234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833dcc5-1756-4081-944e-267e2d38edb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:24.645998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833dcc5-1756-4081-944e-267e2d38edb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:24.646298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833dcc5-1756-4081-944e-267e2d38edb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:24.647698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833dcc5-1756-4081-944e-267e2d38edb3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:24.662074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 121/240] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:24.667999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632076f-f035-41eb-bf85-7c1f5b45f22b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:24.670314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833dcc5-1756-4081-944e-267e2d38edb3 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:24.797454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833dcc5-1756-4081-944e-267e2d38edb3 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:24.799228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:24.844885 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb448c1e-cd11-4e4e-b3c0-2e58d8eea375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:24.845704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb448c1e-cd11-4e4e-b3c0-2e58d8eea375 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:24.845984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb448c1e-cd11-4e4e-b3c0-2e58d8eea375 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:24.846350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb448c1e-cd11-4e4e-b3c0-2e58d8eea375 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:24.860459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb448c1e-cd11-4e4e-b3c0-2e58d8eea375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-bb448c1e-cd11-4e4e-b3c0-2e58d8eea375 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:24.872549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:24.874557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 122/241] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:24.876528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f240b83-e4d4-4941-8334-6635a8d3d46d None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:24.877889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f240b83-e4d4-4941-8334-6635a8d3d46d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:24.877889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f240b83-e4d4-4941-8334-6635a8d3d46d None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:24.877889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 123/242] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:24.882121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632076f-f035-41eb-bf85-7c1f5b45f22b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:24.883162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f240b83-e4d4-4941-8334-6635a8d3d46d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:24.926813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862e1cc-26fb-4767-9d36-f9f2324a43e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:24.927716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862e1cc-26fb-4767-9d36-f9f2324a43e2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:24.928022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862e1cc-26fb-4767-9d36-f9f2324a43e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:24.928362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862e1cc-26fb-4767-9d36-f9f2324a43e2 None admin] PATH_INFO: `/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:24.930034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862e1cc-26fb-4767-9d36-f9f2324a43e2 None admin] RBAC: Authorizing `identity:get_user(user_id=1e13a9d3d47a4efbbd69b0a24213ffe1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:24.931477 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862e1cc-26fb-4767-9d36-f9f2324a43e2 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:24.933711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 120/243] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:24 2022] GET /identity/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1 => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:24.939200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73329091-525f-43a5-a5fa-4e1dfc388e71 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:24.939550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73329091-525f-43a5-a5fa-4e1dfc388e71 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:24.939843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73329091-525f-43a5-a5fa-4e1dfc388e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:24.993005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-73329091-525f-43a5-a5fa-4e1dfc388e71 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:24.995146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-73329091-525f-43a5-a5fa-4e1dfc388e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:25.014317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f240b83-e4d4-4941-8334-6635a8d3d46d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:25.063239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcaa2f-bb41-41e3-90e4-aa0bc880c951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:25.064242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcaa2f-bb41-41e3-90e4-aa0bc880c951 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.064979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcaa2f-bb41-41e3-90e4-aa0bc880c951 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.065940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcaa2f-bb41-41e3-90e4-aa0bc880c951 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.067149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcaa2f-bb41-41e3-90e4-aa0bc880c951 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:25.067677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcaa2f-bb41-41e3-90e4-aa0bc880c951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:25.070111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcaa2f-bb41-41e3-90e4-aa0bc880c951 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:25.081143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:25.086578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 124/244] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:25.087945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcaa2f-bb41-41e3-90e4-aa0bc880c951 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:25.092907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 121/245] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:25.092907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3ffc-6e1d-4b53-9c1f-d5111702a5bd None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.092907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3ffc-6e1d-4b53-9c1f-d5111702a5bd None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.092907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3ffc-6e1d-4b53-9c1f-d5111702a5bd None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.092907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 122/246] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:25.097470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3ffc-6e1d-4b53-9c1f-d5111702a5bd None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:25.126292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:25.200865 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcaa2f-bb41-41e3-90e4-aa0bc880c951 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:25.201132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3ffc-6e1d-4b53-9c1f-d5111702a5bd None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:25.236587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356264b5-57ba-4436-a384-4d1788f40b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:25.237464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356264b5-57ba-4436-a384-4d1788f40b62 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.237744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356264b5-57ba-4436-a384-4d1788f40b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.238021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356264b5-57ba-4436-a384-4d1788f40b62 None admin] PATH_INFO: `/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.238122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c5d25-13df-474e-b41c-2fcc368f7e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:25.238806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c5d25-13df-474e-b41c-2fcc368f7e2d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.239157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c5d25-13df-474e-b41c-2fcc368f7e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.239244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356264b5-57ba-4436-a384-4d1788f40b62 None admin] RBAC: Authorizing `identity:get_user(user_id=1e13a9d3d47a4efbbd69b0a24213ffe1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:25.239484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c5d25-13df-474e-b41c-2fcc368f7e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.240722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356264b5-57ba-4436-a384-4d1788f40b62 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:25.242518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 123/247] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:25 2022] GET /identity/v3/users/1e13a9d3d47a4efbbd69b0a24213ffe1 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:25.243886 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acd660-ccc9-46cd-8256-945705b4392a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.244946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acd660-ccc9-46cd-8256-945705b4392a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.244946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acd660-ccc9-46cd-8256-945705b4392a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.262609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a7acd660-ccc9-46cd-8256-945705b4392a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:25.263837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a7acd660-ccc9-46cd-8256-945705b4392a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:25.314575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c5d25-13df-474e-b41c-2fcc368f7e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:25.316105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c5d25-13df-474e-b41c-2fcc368f7e2d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:25.323864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:25.335578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 124/248] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:25.340964 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:25.344786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acd660-ccc9-46cd-8256-945705b4392a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:25.419817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 125/249] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:25.421180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4891b-183d-486e-8c1e-cc1e718af2d7 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.421629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4891b-183d-486e-8c1e-cc1e718af2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.422087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4891b-183d-486e-8c1e-cc1e718af2d7 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.423533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 126/250] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:25.424413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4891b-183d-486e-8c1e-cc1e718af2d7 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:25.462682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acd660-ccc9-46cd-8256-945705b4392a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:25.497200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb39e5-32e6-46dd-bffe-ed7d6aae9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:25.498085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb39e5-32e6-46dd-bffe-ed7d6aae9c03 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.498435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb39e5-32e6-46dd-bffe-ed7d6aae9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.498776 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb39e5-32e6-46dd-bffe-ed7d6aae9c03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.509563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb39e5-32e6-46dd-bffe-ed7d6aae9c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-49fb39e5-32e6-46dd-bffe-ed7d6aae9c03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:25.517381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:25.518370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:25.519230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 125/251] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:25.519945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb39e5-32e6-46dd-bffe-ed7d6aae9c03 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:25.537356 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4891b-183d-486e-8c1e-cc1e718af2d7 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:25.563983 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:25.573853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:25.575643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61468eaf-68d5-4d3c-acf3-d71019bf2c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:25.576547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61468eaf-68d5-4d3c-acf3-d71019bf2c87 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.576836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61468eaf-68d5-4d3c-acf3-d71019bf2c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.577161 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61468eaf-68d5-4d3c-acf3-d71019bf2c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.620287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb39e5-32e6-46dd-bffe-ed7d6aae9c03 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:25.647193 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61468eaf-68d5-4d3c-acf3-d71019bf2c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:25.648983 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61468eaf-68d5-4d3c-acf3-d71019bf2c87 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:25.654756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61fcb5-bc8c-48eb-9e37-1e58784509eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:25.655585 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fcb5-bc8c-48eb-9e37-1e58784509eb None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.655840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fcb5-bc8c-48eb-9e37-1e58784509eb None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.656155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fcb5-bc8c-48eb-9e37-1e58784509eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.666175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61fcb5-bc8c-48eb-9e37-1e58784509eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-1c61fcb5-bc8c-48eb-9e37-1e58784509eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:25.674491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:25.675423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:25.676229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 126/252] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:25.676884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61fcb5-bc8c-48eb-9e37-1e58784509eb None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:25.755630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 127/253] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:25.756706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e3c42-cc92-4117-91b1-910a8985408d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.756987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e3c42-cc92-4117-91b1-910a8985408d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.757265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e3c42-cc92-4117-91b1-910a8985408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.773606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-bf0e3c42-cc92-4117-91b1-910a8985408d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:25.775019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-bf0e3c42-cc92-4117-91b1-910a8985408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:25.785592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61fcb5-bc8c-48eb-9e37-1e58784509eb None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:25.793726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:25.800296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:25.821010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c932a1-5b9d-49a0-aca8-47b83f1b9959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:25.821871 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c932a1-5b9d-49a0-aca8-47b83f1b9959 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.822158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c932a1-5b9d-49a0-aca8-47b83f1b9959 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.822430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c932a1-5b9d-49a0-aca8-47b83f1b9959 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.823603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c932a1-5b9d-49a0-aca8-47b83f1b9959 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:25.825079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c932a1-5b9d-49a0-aca8-47b83f1b9959 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:25.826757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 127/254] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:25 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:25.827555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c932a1-5b9d-49a0-aca8-47b83f1b9959 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:25.848445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 128/255] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:25.849297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e3c42-cc92-4117-91b1-910a8985408d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:25.934557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c932a1-5b9d-49a0-aca8-47b83f1b9959 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:25.971118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b81e9-c296-4eff-8839-31939fd03621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:25.971769 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b81e9-c296-4eff-8839-31939fd03621 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:25.972078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b81e9-c296-4eff-8839-31939fd03621 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:25.972361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b81e9-c296-4eff-8839-31939fd03621 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:25.973100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b81e9-c296-4eff-8839-31939fd03621 None admin] RBAC: Adding query filter params (name=member) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:25.973406 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b81e9-c296-4eff-8839-31939fd03621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:25.974802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b81e9-c296-4eff-8839-31939fd03621 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:25.975863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e3c42-cc92-4117-91b1-910a8985408d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:25.987702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 128/256] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:25.987702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b81e9-c296-4eff-8839-31939fd03621 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:26.020368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebeb53-3536-41e2-a8ff-a38e352c876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.021108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebeb53-3536-41e2-a8ff-a38e352c876c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.021217 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebeb53-3536-41e2-a8ff-a38e352c876c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.021491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebeb53-3536-41e2-a8ff-a38e352c876c None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.022238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebeb53-3536-41e2-a8ff-a38e352c876c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:26.022552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebeb53-3536-41e2-a8ff-a38e352c876c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.023961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebeb53-3536-41e2-a8ff-a38e352c876c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:26.031922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:26.032785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 129/257] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:26.033541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebeb53-3536-41e2-a8ff-a38e352c876c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:26.057892 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:26.096533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b81e9-c296-4eff-8839-31939fd03621 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:26.136135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86223686-5172-4c54-bd58-03c5da3132b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.137528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223686-5172-4c54-bd58-03c5da3132b0 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.137931 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223686-5172-4c54-bd58-03c5da3132b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.138364 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223686-5172-4c54-bd58-03c5da3132b0 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.140527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86223686-5172-4c54-bd58-03c5da3132b0 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.142955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86223686-5172-4c54-bd58-03c5da3132b0 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:26.151132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 129/258] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:25 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:26.151287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebeb53-3536-41e2-a8ff-a38e352c876c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:26.151718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86223686-5172-4c54-bd58-03c5da3132b0 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:26.187803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f07de-3cee-43d2-b296-84f35a2afd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.188526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f07de-3cee-43d2-b296-84f35a2afd8d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.188868 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f07de-3cee-43d2-b296-84f35a2afd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.189147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f07de-3cee-43d2-b296-84f35a2afd8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.190061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f07de-3cee-43d2-b296-84f35a2afd8d None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=d287700518a644f8bd9772318b8e8e0e, user.id=1e13a9d3d47a4efbbd69b0a24213ffe1) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:26.190377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f07de-3cee-43d2-b296-84f35a2afd8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.191989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f07de-3cee-43d2-b296-84f35a2afd8d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:26.198309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 130/259] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:26 2022] GET /identity/v3/role_assignments?user.id=1e13a9d3d47a4efbbd69b0a24213ffe1&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=31c5600d1f984a04827cf0052fc61678 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:26.199204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f07de-3cee-43d2-b296-84f35a2afd8d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:26.286202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86223686-5172-4c54-bd58-03c5da3132b0 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:26.297453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:26.305591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:26.321860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8fa83-7ed2-4e53-a8a0-e928fc5944f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.322687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8fa83-7ed2-4e53-a8a0-e928fc5944f1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.322974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8fa83-7ed2-4e53-a8a0-e928fc5944f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.323257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8fa83-7ed2-4e53-a8a0-e928fc5944f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.324543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8fa83-7ed2-4e53-a8a0-e928fc5944f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.326019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8fa83-7ed2-4e53-a8a0-e928fc5944f1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:26.326523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f07de-3cee-43d2-b296-84f35a2afd8d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:26.328254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 130/260] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:26.329053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8fa83-7ed2-4e53-a8a0-e928fc5944f1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:26.369572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71983a-e38f-4320-b4ce-fa00cf7006a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.370098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71983a-e38f-4320-b4ce-fa00cf7006a8 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.370386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71983a-e38f-4320-b4ce-fa00cf7006a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.370667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71983a-e38f-4320-b4ce-fa00cf7006a8 None admin] PATH_INFO: `/v3/users/7eaac49c3b9640ecbb24abe4677b754a` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.372091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71983a-e38f-4320-b4ce-fa00cf7006a8 None admin] RBAC: Authorizing `identity:get_user(user_id=7eaac49c3b9640ecbb24abe4677b754a)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.373550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71983a-e38f-4320-b4ce-fa00cf7006a8 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:26.375319 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 131/261] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:26 2022] GET /identity/v3/users/7eaac49c3b9640ecbb24abe4677b754a => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:26.376160 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71983a-e38f-4320-b4ce-fa00cf7006a8 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:26.452820 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8fa83-7ed2-4e53-a8a0-e928fc5944f1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:26.500713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac3c03-333f-42b7-9d9a-50a1c52237c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.502107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3c03-333f-42b7-9d9a-50a1c52237c0 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.502255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71983a-e38f-4320-b4ce-fa00cf7006a8 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:26.502362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3c03-333f-42b7-9d9a-50a1c52237c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.502362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3c03-333f-42b7-9d9a-50a1c52237c0 None admin] PATH_INFO: `/v3/users/d306a10b1b8b44629511d4a78c0cd7e7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.523781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac3c03-333f-42b7-9d9a-50a1c52237c0 None admin] RBAC: Authorizing `identity:get_user(user_id=d306a10b1b8b44629511d4a78c0cd7e7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.525519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac3c03-333f-42b7-9d9a-50a1c52237c0 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:26.527541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 131/262] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:26 2022] GET /identity/v3/users/d306a10b1b8b44629511d4a78c0cd7e7 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:26.528313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac3c03-333f-42b7-9d9a-50a1c52237c0 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:26.541500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d72aa9-eb78-46e5-8a78-995909b438c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.542121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d72aa9-eb78-46e5-8a78-995909b438c5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.542403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d72aa9-eb78-46e5-8a78-995909b438c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.542677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d72aa9-eb78-46e5-8a78-995909b438c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.543553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d72aa9-eb78-46e5-8a78-995909b438c5 None admin] RBAC: Adding query filter params (role.id=c0027060d6364e5e9bd9c2cb5ad9788f, scope.project.id=d287700518a644f8bd9772318b8e8e0e, user.id=1e13a9d3d47a4efbbd69b0a24213ffe1) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:26.543867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d72aa9-eb78-46e5-8a78-995909b438c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.545340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d72aa9-eb78-46e5-8a78-995909b438c5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:26.561960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 132/263] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:26 2022] GET /identity/v3/role_assignments?user.id=1e13a9d3d47a4efbbd69b0a24213ffe1&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=c0027060d6364e5e9bd9c2cb5ad9788f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:26.561960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d72aa9-eb78-46e5-8a78-995909b438c5 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:26.569909 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:26.579799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:26.650477 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac3c03-333f-42b7-9d9a-50a1c52237c0 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:26.679978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d72aa9-eb78-46e5-8a78-995909b438c5 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:26.689667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a63794-12a8-41fb-bec3-5a368f8ebd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.690363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a63794-12a8-41fb-bec3-5a368f8ebd72 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.690644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a63794-12a8-41fb-bec3-5a368f8ebd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.690916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a63794-12a8-41fb-bec3-5a368f8ebd72 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.691642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a63794-12a8-41fb-bec3-5a368f8ebd72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.693174 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a63794-12a8-41fb-bec3-5a368f8ebd72 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:26.723478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c3b00-5dd5-4c01-89cb-69d07b339457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.724611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c3b00-5dd5-4c01-89cb-69d07b339457 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.730929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c3b00-5dd5-4c01-89cb-69d07b339457 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.730929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c3b00-5dd5-4c01-89cb-69d07b339457 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.730929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c3b00-5dd5-4c01-89cb-69d07b339457 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.730929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c3b00-5dd5-4c01-89cb-69d07b339457 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:26.730929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 133/264] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:26 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:26.731333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c3b00-5dd5-4c01-89cb-69d07b339457 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:26.802968 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 132/265] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:01:26 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:26.804651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a63794-12a8-41fb-bec3-5a368f8ebd72 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:26.829066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:26.861515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c3b00-5dd5-4c01-89cb-69d07b339457 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:26.906932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835b206-e2d5-437e-9ef1-0acbad8b7727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.907616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835b206-e2d5-437e-9ef1-0acbad8b7727 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.907926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835b206-e2d5-437e-9ef1-0acbad8b7727 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.908208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835b206-e2d5-437e-9ef1-0acbad8b7727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.942992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:26.953409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a63794-12a8-41fb-bec3-5a368f8ebd72 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:26.991998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835b206-e2d5-437e-9ef1-0acbad8b7727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.994055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8c60c-249f-4e17-a53c-9fe89533b371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:26.994850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835b206-e2d5-437e-9ef1-0acbad8b7727 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:26.994955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8c60c-249f-4e17-a53c-9fe89533b371 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:26.997906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8c60c-249f-4e17-a53c-9fe89533b371 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:26.997906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8c60c-249f-4e17-a53c-9fe89533b371 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e/users/7eaac49c3b9640ecbb24abe4677b754a/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:26.997906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8c60c-249f-4e17-a53c-9fe89533b371 None admin] RBAC: Authorizing `identity:create_grant(project_id=d287700518a644f8bd9772318b8e8e0e, user_id=7eaac49c3b9640ecbb24abe4677b754a, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:26.999553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8c60c-249f-4e17-a53c-9fe89533b371 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:27.090353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:27.094563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 133/266] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:01:26 2022] PUT /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e/users/7eaac49c3b9640ecbb24abe4677b754a/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:27.112014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 134/267] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:27.118466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8c60c-249f-4e17-a53c-9fe89533b371 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:27.236884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8c60c-249f-4e17-a53c-9fe89533b371 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:27.278055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047815e5-77b1-42e0-ad79-764e92dc95b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:27.278952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047815e5-77b1-42e0-ad79-764e92dc95b4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:27.279236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047815e5-77b1-42e0-ad79-764e92dc95b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:27.279514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047815e5-77b1-42e0-ad79-764e92dc95b4 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:27.280864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047815e5-77b1-42e0-ad79-764e92dc95b4 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:27.282363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047815e5-77b1-42e0-ad79-764e92dc95b4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:27.284372 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 134/268] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:27 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:27.290229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835b206-e2d5-437e-9ef1-0acbad8b7727 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:27.405886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835b206-e2d5-437e-9ef1-0acbad8b7727 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:27.447560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17af79-09b9-4e63-a28d-f8a2e0ca6472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:27.448379 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17af79-09b9-4e63-a28d-f8a2e0ca6472 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:27.448710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17af79-09b9-4e63-a28d-f8a2e0ca6472 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:27.449045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17af79-09b9-4e63-a28d-f8a2e0ca6472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:27.449950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17af79-09b9-4e63-a28d-f8a2e0ca6472 None admin] RBAC: Adding query filter params (role.id=284d85c470f34ecd9485d00a62dffe68, scope.project.id=d287700518a644f8bd9772318b8e8e0e, user.id=d306a10b1b8b44629511d4a78c0cd7e7) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:27.450302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17af79-09b9-4e63-a28d-f8a2e0ca6472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:27.451971 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17af79-09b9-4e63-a28d-f8a2e0ca6472 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:27.458822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 135/269] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:27 2022] GET /identity/v3/role_assignments?user.id=d306a10b1b8b44629511d4a78c0cd7e7&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=284d85c470f34ecd9485d00a62dffe68 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:29.297018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a016c-14a1-48b0-a7f5-2be0b7b14142 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:29.297538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a016c-14a1-48b0-a7f5-2be0b7b14142 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:29.297612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a016c-14a1-48b0-a7f5-2be0b7b14142 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:29.299192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 135/270] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:29.305065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001ef0-a104-47ba-8b5b-3d58169fc242 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:29.305522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001ef0-a104-47ba-8b5b-3d58169fc242 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:29.305593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001ef0-a104-47ba-8b5b-3d58169fc242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:29.310381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b864e4-f136-4312-818d-0e8eb40a3db6 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:29.310673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b864e4-f136-4312-818d-0e8eb40a3db6 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:29.310957 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b864e4-f136-4312-818d-0e8eb40a3db6 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:29.313166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 136/271] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:01:29.318471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd9326-c28d-4f71-9043-85a3a7959135 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:29.318761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd9326-c28d-4f71-9043-85a3a7959135 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:29.319036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd9326-c28d-4f71-9043-85a3a7959135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:29.324787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-cd001ef0-a104-47ba-8b5b-3d58169fc242 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:29.325965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-cd001ef0-a104-47ba-8b5b-3d58169fc242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:29.336078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-2cbd9326-c28d-4f71-9043-85a3a7959135 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:29.337348 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2cbd9326-c28d-4f71-9043-85a3a7959135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:29.368283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:29.368510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:29.403266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 136/272] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:29.408594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 137/273] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:29.435684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd001ef0-a104-47ba-8b5b-3d58169fc242 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:29.440357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd9326-c28d-4f71-9043-85a3a7959135 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:29.545243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd001ef0-a104-47ba-8b5b-3d58169fc242 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:29.559318 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd9326-c28d-4f71-9043-85a3a7959135 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:29.586373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8329a73-72ac-43e9-b075-d5476c9786bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:29.587330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329a73-72ac-43e9-b075-d5476c9786bb None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:29.587617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329a73-72ac-43e9-b075-d5476c9786bb None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:29.587929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8329a73-72ac-43e9-b075-d5476c9786bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:29.597002 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb8613-6f22-47e7-9fca-8a847484a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:29.597817 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb8613-6f22-47e7-9fca-8a847484a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:29.598098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb8613-6f22-47e7-9fca-8a847484a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:29.598371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb8613-6f22-47e7-9fca-8a847484a0a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:29.599622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb8613-6f22-47e7-9fca-8a847484a0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:29.600821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8329a73-72ac-43e9-b075-d5476c9786bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:29.601229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb8613-6f22-47e7-9fca-8a847484a0a3 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:29.603172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 138/274] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:29.604288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d750fb-94ca-49c9-9a73-61b7a95b9c3c None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:29.604572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d750fb-94ca-49c9-9a73-61b7a95b9c3c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:29.604848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d750fb-94ca-49c9-9a73-61b7a95b9c3c None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:29.611063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 139/275] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:29.620392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d750fb-94ca-49c9-9a73-61b7a95b9c3c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-f8329a73-72ac-43e9-b075-d5476c9786bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:29.620533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:29.621343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 137/276] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:29.622118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ec60-8a88-4edf-80f8-13e082a1bf58 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:29.622931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ec60-8a88-4edf-80f8-13e082a1bf58 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:29.622931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ec60-8a88-4edf-80f8-13e082a1bf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:29.637196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:29.640747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f797ec60-8a88-4edf-80f8-13e082a1bf58 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:29.641929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f797ec60-8a88-4edf-80f8-13e082a1bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:29.669646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:29.711976 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 138/277] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:29.712877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ec60-8a88-4edf-80f8-13e082a1bf58 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:29.771010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d750fb-94ca-49c9-9a73-61b7a95b9c3c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:29.807718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6ca60-0924-4ff7-85a0-bf52bf5d09ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:29.808416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ca60-0924-4ff7-85a0-bf52bf5d09ca None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:29.808698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ca60-0924-4ff7-85a0-bf52bf5d09ca None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:29.808971 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ca60-0924-4ff7-85a0-bf52bf5d09ca None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:29.809727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6ca60-0924-4ff7-85a0-bf52bf5d09ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:29.811119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6ca60-0924-4ff7-85a0-bf52bf5d09ca None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:29.821410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ec60-8a88-4edf-80f8-13e082a1bf58 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:29.855081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82bf50-004e-405c-904f-1833a5c9c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:29.855747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82bf50-004e-405c-904f-1833a5c9c591 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:29.856071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82bf50-004e-405c-904f-1833a5c9c591 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:29.856344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82bf50-004e-405c-904f-1833a5c9c591 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:29.857131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82bf50-004e-405c-904f-1833a5c9c591 None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:29.857433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82bf50-004e-405c-904f-1833a5c9c591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:29.859372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82bf50-004e-405c-904f-1833a5c9c591 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:29.867275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 139/278] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:29.872130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82bf50-004e-405c-904f-1833a5c9c591 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:29.897867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:29.915924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 140/279] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:01:29 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:29.916716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6ca60-0924-4ff7-85a0-bf52bf5d09ca None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:29.993808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82bf50-004e-405c-904f-1833a5c9c591 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:30.011816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:30.032974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2da696-2428-4ae9-a452-86fce064fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:30.033793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da696-2428-4ae9-a452-86fce064fb5c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:30.034075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da696-2428-4ae9-a452-86fce064fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:30.034354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da696-2428-4ae9-a452-86fce064fb5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:30.040822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6ca60-0924-4ff7-85a0-bf52bf5d09ca None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:30.046818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2da696-2428-4ae9-a452-86fce064fb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-ea2da696-2428-4ae9-a452-86fce064fb5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:30.055062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:30.056242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:30.057058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 140/280] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:30.057845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f3b2-271c-46bc-bd42-2552058847da None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:30.058176 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f3b2-271c-46bc-bd42-2552058847da None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:30.058461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f3b2-271c-46bc-bd42-2552058847da None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:30.059899 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 141/281] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:30.062915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f3b2-271c-46bc-bd42-2552058847da None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:30.089832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47994f2c-0020-4974-a728-4b5425671cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:30.090907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47994f2c-0020-4974-a728-4b5425671cda None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:30.091593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47994f2c-0020-4974-a728-4b5425671cda None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:30.092409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47994f2c-0020-4974-a728-4b5425671cda None admin] PATH_INFO: `/v3/users/ac57171453e444d1a44bc784ea108fa7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:30.112160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47994f2c-0020-4974-a728-4b5425671cda None admin] RBAC: Authorizing `identity:get_user(user_id=ac57171453e444d1a44bc784ea108fa7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:30.113668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47994f2c-0020-4974-a728-4b5425671cda None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:30.115409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 141/282] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:29 2022] GET /identity/v3/users/ac57171453e444d1a44bc784ea108fa7 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:30.116669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb315e-68a6-4fbe-8e39-40f56e50d703 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:30.116954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb315e-68a6-4fbe-8e39-40f56e50d703 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:30.117226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb315e-68a6-4fbe-8e39-40f56e50d703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:30.136641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-34cb315e-68a6-4fbe-8e39-40f56e50d703 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:30.137855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-34cb315e-68a6-4fbe-8e39-40f56e50d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:30.178658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:30.195091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f3b2-271c-46bc-bd42-2552058847da None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:30.224949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 142/283] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:30.225990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb315e-68a6-4fbe-8e39-40f56e50d703 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:30.241934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e9701-266f-4e20-8305-b10e078d2480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:30.242998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e9701-266f-4e20-8305-b10e078d2480 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:30.243328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e9701-266f-4e20-8305-b10e078d2480 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:30.243656 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e9701-266f-4e20-8305-b10e078d2480 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:30.244528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e9701-266f-4e20-8305-b10e078d2480 None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:30.244875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e9701-266f-4e20-8305-b10e078d2480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:30.247498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e9701-266f-4e20-8305-b10e078d2480 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:30.262926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 142/284] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:30.268076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e9701-266f-4e20-8305-b10e078d2480 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:30.294686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:30.342966 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb315e-68a6-4fbe-8e39-40f56e50d703 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:30.390761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f4cf3-3ba0-4856-8ed8-78266a0d8cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:30.390761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f4cf3-3ba0-4856-8ed8-78266a0d8cba None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:30.390761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f4cf3-3ba0-4856-8ed8-78266a0d8cba None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:30.390761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f4cf3-3ba0-4856-8ed8-78266a0d8cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:30.391207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f4cf3-3ba0-4856-8ed8-78266a0d8cba None admin] RBAC: Adding query filter params (role.id=b35814b03f814680843c3aead86264f7, user.id=ac57171453e444d1a44bc784ea108fa7, scope.system=all) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:30.394338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f4cf3-3ba0-4856-8ed8-78266a0d8cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:30.394338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f4cf3-3ba0-4856-8ed8-78266a0d8cba None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:30.403954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e9701-266f-4e20-8305-b10e078d2480 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:30.404453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 143/285] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Jun 2 13:01:30 2022] GET /identity/v3/role_assignments?user.id=ac57171453e444d1a44bc784ea108fa7&scope.system=all&role.id=b35814b03f814680843c3aead86264f7 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:30.404453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f4cf3-3ba0-4856-8ed8-78266a0d8cba None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:30.503080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a16734-bfb9-4755-98c9-21d0c7fa68db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:30.503968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a16734-bfb9-4755-98c9-21d0c7fa68db None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:30.504207 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a16734-bfb9-4755-98c9-21d0c7fa68db None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:30.504477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a16734-bfb9-4755-98c9-21d0c7fa68db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:30.528727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a16734-bfb9-4755-98c9-21d0c7fa68db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-c7a16734-bfb9-4755-98c9-21d0c7fa68db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:30.537124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:30.539428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:30.540254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 143/286] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:30.546937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a16734-bfb9-4755-98c9-21d0c7fa68db None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:30.571040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f4cf3-3ba0-4856-8ed8-78266a0d8cba None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:30.609953 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:30.666493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:30.679045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fddc6-2dd0-47a8-8605-207b6ec32616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:30.680253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fddc6-2dd0-47a8-8605-207b6ec32616 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:30.680538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fddc6-2dd0-47a8-8605-207b6ec32616 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:30.680811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fddc6-2dd0-47a8-8605-207b6ec32616 None admin] PATH_INFO: `/v3/users/7eaac49c3b9640ecbb24abe4677b754a` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:30.686087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fddc6-2dd0-47a8-8605-207b6ec32616 None admin] RBAC: Authorizing `identity:get_user(user_id=7eaac49c3b9640ecbb24abe4677b754a)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:30.688140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fddc6-2dd0-47a8-8605-207b6ec32616 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:30.690039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 144/287] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:30 2022] GET /identity/v3/users/7eaac49c3b9640ecbb24abe4677b754a => generated 297 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:30.700914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fddc6-2dd0-47a8-8605-207b6ec32616 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:30.741537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a16734-bfb9-4755-98c9-21d0c7fa68db None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:30.784322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892e1c-6cda-42fe-acbe-bf3c25011007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:30.785494 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892e1c-6cda-42fe-acbe-bf3c25011007 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:30.786054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892e1c-6cda-42fe-acbe-bf3c25011007 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:30.786591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892e1c-6cda-42fe-acbe-bf3c25011007 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:30.787682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892e1c-6cda-42fe-acbe-bf3c25011007 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:30.788274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892e1c-6cda-42fe-acbe-bf3c25011007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:30.790308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892e1c-6cda-42fe-acbe-bf3c25011007 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:30.801415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 144/288] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:30.807831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892e1c-6cda-42fe-acbe-bf3c25011007 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:30.942472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fddc6-2dd0-47a8-8605-207b6ec32616 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:30.955807 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:30.994291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892e1c-6cda-42fe-acbe-bf3c25011007 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:31.029976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc633f36-1773-4dde-a873-89fc63ee395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:31.030661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc633f36-1773-4dde-a873-89fc63ee395f None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:31.030961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc633f36-1773-4dde-a873-89fc63ee395f None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:31.031248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc633f36-1773-4dde-a873-89fc63ee395f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:31.041586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bbf66-a308-46ae-8e48-2e9beaa123a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:31.042893 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bbf66-a308-46ae-8e48-2e9beaa123a0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:31.043417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bbf66-a308-46ae-8e48-2e9beaa123a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:31.044064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bbf66-a308-46ae-8e48-2e9beaa123a0 None admin] PATH_INFO: `/v3/users/d306a10b1b8b44629511d4a78c0cd7e7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:31.046421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bbf66-a308-46ae-8e48-2e9beaa123a0 None admin] RBAC: Authorizing `identity:get_user(user_id=d306a10b1b8b44629511d4a78c0cd7e7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:31.048395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bbf66-a308-46ae-8e48-2e9beaa123a0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:31.050799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 145/289] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:30 2022] GET /identity/v3/users/d306a10b1b8b44629511d4a78c0cd7e7 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:31.057626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bbf66-a308-46ae-8e48-2e9beaa123a0 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:31.143278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:31.165332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc633f36-1773-4dde-a873-89fc63ee395f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:31.166987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc633f36-1773-4dde-a873-89fc63ee395f None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:31.191428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bbf66-a308-46ae-8e48-2e9beaa123a0 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:31.233467 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9239-094d-47ab-8f7e-092ffe1c8f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:31.234842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9239-094d-47ab-8f7e-092ffe1c8f76 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:31.235374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9239-094d-47ab-8f7e-092ffe1c8f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:31.235965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9239-094d-47ab-8f7e-092ffe1c8f76 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:31.237565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df9239-094d-47ab-8f7e-092ffe1c8f76 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:31.239594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df9239-094d-47ab-8f7e-092ffe1c8f76 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:31.241904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 146/290] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:31 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:31.249539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9239-094d-47ab-8f7e-092ffe1c8f76 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:31.266151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:31.405931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9239-094d-47ab-8f7e-092ffe1c8f76 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:31.443142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 145/291] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:31.454773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef66aff-b149-4982-aee8-7ef0a49bc7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:31.456166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef66aff-b149-4982-aee8-7ef0a49bc7a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:31.456740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef66aff-b149-4982-aee8-7ef0a49bc7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:31.457297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef66aff-b149-4982-aee8-7ef0a49bc7a6 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e/users/d306a10b1b8b44629511d4a78c0cd7e7/roles/284d85c470f34ecd9485d00a62dffe68` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:31.460350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef66aff-b149-4982-aee8-7ef0a49bc7a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d287700518a644f8bd9772318b8e8e0e, user_id=d306a10b1b8b44629511d4a78c0cd7e7, role_id=284d85c470f34ecd9485d00a62dffe68)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:31.460918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc633f36-1773-4dde-a873-89fc63ee395f None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:31.462559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef66aff-b149-4982-aee8-7ef0a49bc7a6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:31.544805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 147/292] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:01:31 2022] PUT /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e/users/d306a10b1b8b44629511d4a78c0cd7e7/roles/284d85c470f34ecd9485d00a62dffe68 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:01:31.595263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:31.603842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc633f36-1773-4dde-a873-89fc63ee395f None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:31.649721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334acb0-4c78-4f51-b7f6-d99f5a96cf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:31.651163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334acb0-4c78-4f51-b7f6-d99f5a96cf86 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:31.651752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334acb0-4c78-4f51-b7f6-d99f5a96cf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:31.652363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334acb0-4c78-4f51-b7f6-d99f5a96cf86 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:31.654073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334acb0-4c78-4f51-b7f6-d99f5a96cf86 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:31.655928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334acb0-4c78-4f51-b7f6-d99f5a96cf86 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:31.663674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 146/293] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:31 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:31.664873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef66aff-b149-4982-aee8-7ef0a49bc7a6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:31.777716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:31.833632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef66aff-b149-4982-aee8-7ef0a49bc7a6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:31.878451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e41bfd-38d3-4a64-bde1-bce4b7e89516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:31.879126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e41bfd-38d3-4a64-bde1-bce4b7e89516 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:31.879404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e41bfd-38d3-4a64-bde1-bce4b7e89516 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:31.879718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e41bfd-38d3-4a64-bde1-bce4b7e89516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:31.880664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e41bfd-38d3-4a64-bde1-bce4b7e89516 None admin] RBAC: Adding query filter params (role.id=b35814b03f814680843c3aead86264f7, scope.project.id=d287700518a644f8bd9772318b8e8e0e, user.id=7eaac49c3b9640ecbb24abe4677b754a) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:31.880941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e41bfd-38d3-4a64-bde1-bce4b7e89516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:31.882376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e41bfd-38d3-4a64-bde1-bce4b7e89516 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:31.891714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 148/294] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:31 2022] GET /identity/v3/role_assignments?user.id=7eaac49c3b9640ecbb24abe4677b754a&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=b35814b03f814680843c3aead86264f7 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:32.574846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d5510-d57a-40ce-a34b-12b057e39f98 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:32.575933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d5510-d57a-40ce-a34b-12b057e39f98 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:32.576437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d5510-d57a-40ce-a34b-12b057e39f98 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:32.578264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 147/295] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:32.584012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aece8f-58cf-45bc-a18f-c9517d8c5535 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:32.584984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aece8f-58cf-45bc-a18f-c9517d8c5535 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:32.585538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aece8f-58cf-45bc-a18f-c9517d8c5535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:32.608677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f1aece8f-58cf-45bc-a18f-c9517d8c5535 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:32.610341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f1aece8f-58cf-45bc-a18f-c9517d8c5535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:32.700987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 149/296] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:32.724185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d5510-d57a-40ce-a34b-12b057e39f98 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:32.830486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d5510-d57a-40ce-a34b-12b057e39f98 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:32.865318 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa82375-34f4-448a-a6ff-18fcca6ba5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:32.866127 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82375-34f4-448a-a6ff-18fcca6ba5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:32.866411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82375-34f4-448a-a6ff-18fcca6ba5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:32.866687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82375-34f4-448a-a6ff-18fcca6ba5b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:32.877751 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa82375-34f4-448a-a6ff-18fcca6ba5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:32.882717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f0028-1092-421c-99bb-fd724cd3bac4 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:32.883016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f0028-1092-421c-99bb-fd724cd3bac4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:32.883297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f0028-1092-421c-99bb-fd724cd3bac4 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:32.884735 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 150/297] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-0aa82375-34f4-448a-a6ff-18fcca6ba5b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:32.885685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:32.886563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:32.887514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 148/298] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:32.889925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495f5ee-1023-4a89-afe5-1b15a8d67c0c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:32.890210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495f5ee-1023-4a89-afe5-1b15a8d67c0c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:32.890484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495f5ee-1023-4a89-afe5-1b15a8d67c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:32.892410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa82375-34f4-448a-a6ff-18fcca6ba5b9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:32.908148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0495f5ee-1023-4a89-afe5-1b15a8d67c0c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:32.909828 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0495f5ee-1023-4a89-afe5-1b15a8d67c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:32.918852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:32.980515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:32.990210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 151/299] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:33.006524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa82375-34f4-448a-a6ff-18fcca6ba5b9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:33.011591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa3e22-dd59-4623-a87b-f313e644dea9 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:33.011949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa3e22-dd59-4623-a87b-f313e644dea9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:33.012199 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa3e22-dd59-4623-a87b-f313e644dea9 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:33.013830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 152/300] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:33.019523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361902-143c-4274-aa74-3c5ba71bf2c6 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:33.019815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361902-143c-4274-aa74-3c5ba71bf2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:33.020119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361902-143c-4274-aa74-3c5ba71bf2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:33.037316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-01361902-143c-4274-aa74-3c5ba71bf2c6 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:33.038490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-01361902-143c-4274-aa74-3c5ba71bf2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:33.048267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc79bf-c6b8-4fef-a296-fb560791b7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:33.048945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc79bf-c6b8-4fef-a296-fb560791b7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:33.049230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc79bf-c6b8-4fef-a296-fb560791b7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:33.049506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc79bf-c6b8-4fef-a296-fb560791b7f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:33.050266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc79bf-c6b8-4fef-a296-fb560791b7f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:33.050574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc79bf-c6b8-4fef-a296-fb560791b7f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:33.051965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc79bf-c6b8-4fef-a296-fb560791b7f5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:33.060544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 149/301] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:33.061268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc79bf-c6b8-4fef-a296-fb560791b7f5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:33.117922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 153/302] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:33.125530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01361902-143c-4274-aa74-3c5ba71bf2c6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:33.148971 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:33.165879 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc79bf-c6b8-4fef-a296-fb560791b7f5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:33.207254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258945fc-a5eb-4189-b1fa-ba6e9a39fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:33.208092 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258945fc-a5eb-4189-b1fa-ba6e9a39fb13 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:33.208378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258945fc-a5eb-4189-b1fa-ba6e9a39fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:33.208654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258945fc-a5eb-4189-b1fa-ba6e9a39fb13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:33.210234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258945fc-a5eb-4189-b1fa-ba6e9a39fb13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:33.212087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258945fc-a5eb-4189-b1fa-ba6e9a39fb13 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:33.219349 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 150/303] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:33.219349 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258945fc-a5eb-4189-b1fa-ba6e9a39fb13 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:33.235170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01361902-143c-4274-aa74-3c5ba71bf2c6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:33.254962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:33.270582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c7ef8-4e6d-435d-a612-2f50993deb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:33.271462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7ef8-4e6d-435d-a612-2f50993deb80 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:33.271745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7ef8-4e6d-435d-a612-2f50993deb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:33.272052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7ef8-4e6d-435d-a612-2f50993deb80 None admin] PATH_INFO: `/v3/users/a3f55817686e461ca356e7f7259c5c3d` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:33.287403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c7ef8-4e6d-435d-a612-2f50993deb80 None admin] RBAC: Authorizing `identity:get_user(user_id=a3f55817686e461ca356e7f7259c5c3d)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:33.288988 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c7ef8-4e6d-435d-a612-2f50993deb80 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:33.295200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 154/304] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:33 2022] GET /identity/v3/users/a3f55817686e461ca356e7f7259c5c3d => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:33.295200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c7ef8-4e6d-435d-a612-2f50993deb80 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:33.337180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258945fc-a5eb-4189-b1fa-ba6e9a39fb13 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:33.370869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72bbc7-51a2-4bd6-ab20-cec6f00be8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:33.371752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72bbc7-51a2-4bd6-ab20-cec6f00be8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:33.372129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72bbc7-51a2-4bd6-ab20-cec6f00be8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:33.372409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72bbc7-51a2-4bd6-ab20-cec6f00be8c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:33.386084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72bbc7-51a2-4bd6-ab20-cec6f00be8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-5f72bbc7-51a2-4bd6-ab20-cec6f00be8c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:33.394593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:33.395487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 151/305] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:33.397328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72bbc7-51a2-4bd6-ab20-cec6f00be8c4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:33.413011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:33.414767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c7ef8-4e6d-435d-a612-2f50993deb80 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:33.452998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23679-0bfb-41de-9ce0-12826e6dfdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:33.453695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23679-0bfb-41de-9ce0-12826e6dfdb5 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:33.454006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23679-0bfb-41de-9ce0-12826e6dfdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:33.454285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23679-0bfb-41de-9ce0-12826e6dfdb5 None admin] PATH_INFO: `/v3/groups` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:33.455035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b23679-0bfb-41de-9ce0-12826e6dfdb5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:33.456596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b23679-0bfb-41de-9ce0-12826e6dfdb5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:33.496153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72bbc7-51a2-4bd6-ab20-cec6f00be8c4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:33.529523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897be68-963f-486a-9fcb-3b7b80bc3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:33.530264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897be68-963f-486a-9fcb-3b7b80bc3859 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:33.530549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897be68-963f-486a-9fcb-3b7b80bc3859 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:33.530830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897be68-963f-486a-9fcb-3b7b80bc3859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:33.531652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897be68-963f-486a-9fcb-3b7b80bc3859 None admin] RBAC: Adding query filter params (role.id=284d85c470f34ecd9485d00a62dffe68, user.id=a3f55817686e461ca356e7f7259c5c3d, scope.system=all) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:33.531994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897be68-963f-486a-9fcb-3b7b80bc3859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:33.533423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897be68-963f-486a-9fcb-3b7b80bc3859 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:33.544202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 155/306] 10.222.0.46 () {60 vars in 1134 bytes} [Thu Jun 2 13:01:33 2022] POST /identity/v3/groups => generated 229 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:33.544202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23679-0bfb-41de-9ce0-12826e6dfdb5 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:33.550248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 152/307] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Jun 2 13:01:33 2022] GET /identity/v3/role_assignments?user.id=a3f55817686e461ca356e7f7259c5c3d&scope.system=all&role.id=284d85c470f34ecd9485d00a62dffe68 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:33.611438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:33.687423 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23679-0bfb-41de-9ce0-12826e6dfdb5 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:33.727834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf798ec-47a5-4016-ab8a-c1da179a88a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:33.728574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf798ec-47a5-4016-ab8a-c1da179a88a0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:33.728861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf798ec-47a5-4016-ab8a-c1da179a88a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:33.729142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf798ec-47a5-4016-ab8a-c1da179a88a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:33.729934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf798ec-47a5-4016-ab8a-c1da179a88a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:33.730246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf798ec-47a5-4016-ab8a-c1da179a88a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:33.731734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf798ec-47a5-4016-ab8a-c1da179a88a0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:33.742618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 156/308] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:33.749384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897be68-963f-486a-9fcb-3b7b80bc3859 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:33.843147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:33.866051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897be68-963f-486a-9fcb-3b7b80bc3859 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:33.902462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237703c2-dce2-48a9-84ae-8a98d83d021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:33.903358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237703c2-dce2-48a9-84ae-8a98d83d021c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:33.903639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237703c2-dce2-48a9-84ae-8a98d83d021c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:33.903941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237703c2-dce2-48a9-84ae-8a98d83d021c None admin] PATH_INFO: `/v3/users/ac57171453e444d1a44bc784ea108fa7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:33.905730 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237703c2-dce2-48a9-84ae-8a98d83d021c None admin] RBAC: Authorizing `identity:get_user(user_id=ac57171453e444d1a44bc784ea108fa7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:33.907252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237703c2-dce2-48a9-84ae-8a98d83d021c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:33.909337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 153/309] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:33 2022] GET /identity/v3/users/ac57171453e444d1a44bc784ea108fa7 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:33.914992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf798ec-47a5-4016-ab8a-c1da179a88a0 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:34.022876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:34.028449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf798ec-47a5-4016-ab8a-c1da179a88a0 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:34.065138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e69acb-da71-41c3-88a4-1271cc6ad5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:34.066074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e69acb-da71-41c3-88a4-1271cc6ad5f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:34.066358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e69acb-da71-41c3-88a4-1271cc6ad5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:34.066717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e69acb-da71-41c3-88a4-1271cc6ad5f5 None admin] PATH_INFO: `/v3/system/users/ac57171453e444d1a44bc784ea108fa7/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:34.068259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e69acb-da71-41c3-88a4-1271cc6ad5f5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac57171453e444d1a44bc784ea108fa7, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:34.069666 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e69acb-da71-41c3-88a4-1271cc6ad5f5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:34.162701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 157/310] 10.222.0.46 () {58 vars in 1334 bytes} [Thu Jun 2 13:01:33 2022] PUT /identity/v3/system/users/ac57171453e444d1a44bc784ea108fa7/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:34.305790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1485d4-aab5-47f1-b5b0-2ce806b27d35 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:34.306136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1485d4-aab5-47f1-b5b0-2ce806b27d35 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:34.306333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1485d4-aab5-47f1-b5b0-2ce806b27d35 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:34.307779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 154/311] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:34.314200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4eb6-8a82-491f-b2b2-2b8e6d835437 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:34.314820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4eb6-8a82-491f-b2b2-2b8e6d835437 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:34.315362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4eb6-8a82-491f-b2b2-2b8e6d835437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:34.334055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-5f9d4eb6-8a82-491f-b2b2-2b8e6d835437 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:34.335684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5f9d4eb6-8a82-491f-b2b2-2b8e6d835437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:34.415557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 158/312] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:34.439711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1485d4-aab5-47f1-b5b0-2ce806b27d35 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:34.549441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1485d4-aab5-47f1-b5b0-2ce806b27d35 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:34.585617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ffad3-842e-483d-b974-a3bc9dcf09b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:34.586702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ffad3-842e-483d-b974-a3bc9dcf09b4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:34.587164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ffad3-842e-483d-b974-a3bc9dcf09b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:34.587630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ffad3-842e-483d-b974-a3bc9dcf09b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:34.606042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ffad3-842e-483d-b974-a3bc9dcf09b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-794ffad3-842e-483d-b974-a3bc9dcf09b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:34.616140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:34.625604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:34.626582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 155/313] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:34.627401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d4eb6-8a82-491f-b2b2-2b8e6d835437 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:34.728298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:34.735452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d4eb6-8a82-491f-b2b2-2b8e6d835437 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:34.771963 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc599a-e765-4527-9ad1-09a04d3137b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:34.772645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc599a-e765-4527-9ad1-09a04d3137b5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:34.772986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc599a-e765-4527-9ad1-09a04d3137b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:34.773266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc599a-e765-4527-9ad1-09a04d3137b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:34.774022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc599a-e765-4527-9ad1-09a04d3137b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:34.774328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc599a-e765-4527-9ad1-09a04d3137b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:34.775707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc599a-e765-4527-9ad1-09a04d3137b5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:34.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 159/314] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:34.789968 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ffad3-842e-483d-b974-a3bc9dcf09b4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:34.796094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:34.899087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ffad3-842e-483d-b974-a3bc9dcf09b4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:34.933291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a60895-0123-49fa-ade3-e08cf68ea42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:34.934169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60895-0123-49fa-ade3-e08cf68ea42b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:34.934452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60895-0123-49fa-ade3-e08cf68ea42b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:34.934727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a60895-0123-49fa-ade3-e08cf68ea42b None admin] PATH_INFO: `/v3/users/d306a10b1b8b44629511d4a78c0cd7e7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:34.935955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a60895-0123-49fa-ade3-e08cf68ea42b None admin] RBAC: Authorizing `identity:get_user(user_id=d306a10b1b8b44629511d4a78c0cd7e7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:34.937933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a60895-0123-49fa-ade3-e08cf68ea42b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:34.939629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 156/315] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:34 2022] GET /identity/v3/users/d306a10b1b8b44629511d4a78c0cd7e7 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:34.945105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc599a-e765-4527-9ad1-09a04d3137b5 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:35.048305 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc599a-e765-4527-9ad1-09a04d3137b5 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:35.083756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb1d82-5608-43c3-ab8b-ae0bf9fc71ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:35.084446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb1d82-5608-43c3-ab8b-ae0bf9fc71ae None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:35.084729 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb1d82-5608-43c3-ab8b-ae0bf9fc71ae None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:35.085006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb1d82-5608-43c3-ab8b-ae0bf9fc71ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:35.136759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:35.158671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb1d82-5608-43c3-ab8b-ae0bf9fc71ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:35.158671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb1d82-5608-43c3-ab8b-ae0bf9fc71ae None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:35.258632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 160/316] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:35.263860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a60895-0123-49fa-ade3-e08cf68ea42b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:35.336331 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:35.366954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a60895-0123-49fa-ade3-e08cf68ea42b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:35.410651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f6379-cc2b-4559-b256-296be0d710aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:35.411466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f6379-cc2b-4559-b256-296be0d710aa None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:35.411750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f6379-cc2b-4559-b256-296be0d710aa None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:35.412102 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f6379-cc2b-4559-b256-296be0d710aa None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:35.413433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f6379-cc2b-4559-b256-296be0d710aa None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:35.414893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f6379-cc2b-4559-b256-296be0d710aa None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:35.416815 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 157/317] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:35 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:35.423125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb1d82-5608-43c3-ab8b-ae0bf9fc71ae None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:35.480378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:35.525596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb1d82-5608-43c3-ab8b-ae0bf9fc71ae None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:35.566465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec547a2-bec3-4e9e-a12f-3c453fbe864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:35.567144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec547a2-bec3-4e9e-a12f-3c453fbe864c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:35.567425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec547a2-bec3-4e9e-a12f-3c453fbe864c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:35.567700 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec547a2-bec3-4e9e-a12f-3c453fbe864c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:35.568587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec547a2-bec3-4e9e-a12f-3c453fbe864c None admin] RBAC: Adding query filter params (role.id=284d85c470f34ecd9485d00a62dffe68, scope.project.id=d287700518a644f8bd9772318b8e8e0e, user.id=d306a10b1b8b44629511d4a78c0cd7e7) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:35.568902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec547a2-bec3-4e9e-a12f-3c453fbe864c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:35.570375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec547a2-bec3-4e9e-a12f-3c453fbe864c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:35.577534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 161/318] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:01:35 2022] GET /identity/v3/role_assignments?user.id=d306a10b1b8b44629511d4a78c0cd7e7&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=284d85c470f34ecd9485d00a62dffe68 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:35.930907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c2293-49c8-48d9-b917-88897fa6670c None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:35.931425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c2293-49c8-48d9-b917-88897fa6670c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:35.931532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c2293-49c8-48d9-b917-88897fa6670c None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:35.933032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 158/319] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:35.938069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bb78c-b934-4b69-b96f-82547b8fc28e None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:35.938461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bb78c-b934-4b69-b96f-82547b8fc28e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:35.938624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bb78c-b934-4b69-b96f-82547b8fc28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:35.955808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-611bb78c-b934-4b69-b96f-82547b8fc28e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:35.957030 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-611bb78c-b934-4b69-b96f-82547b8fc28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:36.026593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 162/320] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:36.049222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c2293-49c8-48d9-b917-88897fa6670c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:36.079623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe662-aa57-4fcb-a795-0111679f9e54 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.080024 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe662-aa57-4fcb-a795-0111679f9e54 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.080255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fe662-aa57-4fcb-a795-0111679f9e54 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.081609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 163/321] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:01:36.086778 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af984-1d1e-461f-b674-bbb21a3424a4 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.087067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af984-1d1e-461f-b674-bbb21a3424a4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.087343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af984-1d1e-461f-b674-bbb21a3424a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.105550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ce4af984-1d1e-461f-b674-bbb21a3424a4 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:36.106731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ce4af984-1d1e-461f-b674-bbb21a3424a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:36.157301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c2293-49c8-48d9-b917-88897fa6670c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:36.159228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:36.180373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 164/322] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:36.193462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915a8dc-9069-496c-9699-00e518681205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:36.194399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915a8dc-9069-496c-9699-00e518681205 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.194699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915a8dc-9069-496c-9699-00e518681205 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.194968 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915a8dc-9069-496c-9699-00e518681205 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.204082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4af984-1d1e-461f-b674-bbb21a3424a4 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:36.205851 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:36.209419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915a8dc-9069-496c-9699-00e518681205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-7915a8dc-9069-496c-9699-00e518681205 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:36.218350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:36.224405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:36.225254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 159/323] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:36.225934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915a8dc-9069-496c-9699-00e518681205 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:36.316418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4af984-1d1e-461f-b674-bbb21a3424a4 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:36.329950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915a8dc-9069-496c-9699-00e518681205 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:36.352465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e91bed-0449-4a65-a4ce-2d971ec41ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:36.353265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91bed-0449-4a65-a4ce-2d971ec41ced None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.353550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91bed-0449-4a65-a4ce-2d971ec41ced None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.353824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91bed-0449-4a65-a4ce-2d971ec41ced None admin] PATH_INFO: `/v3/domains/default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.354977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e91bed-0449-4a65-a4ce-2d971ec41ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:36.356460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e91bed-0449-4a65-a4ce-2d971ec41ced None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:36.362712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 165/324] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:36.363492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e91bed-0449-4a65-a4ce-2d971ec41ced None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:36.364219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f8f5-3917-4603-96fe-a5207d76e0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:36.364892 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f8f5-3917-4603-96fe-a5207d76e0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.365179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f8f5-3917-4603-96fe-a5207d76e0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.365460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f8f5-3917-4603-96fe-a5207d76e0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.366216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8f8f5-3917-4603-96fe-a5207d76e0f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:36.366530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8f8f5-3917-4603-96fe-a5207d76e0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:36.368207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8f8f5-3917-4603-96fe-a5207d76e0f5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:36.380345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 160/325] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:36.383847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f8f5-3917-4603-96fe-a5207d76e0f5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:36.420823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:36.454820 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:36.474287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e91bed-0449-4a65-a4ce-2d971ec41ced None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:36.497374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f8f5-3917-4603-96fe-a5207d76e0f5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:36.509136 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa4d6c-dcfa-4791-8ac9-0201da6f6988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:36.509853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa4d6c-dcfa-4791-8ac9-0201da6f6988 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.510140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa4d6c-dcfa-4791-8ac9-0201da6f6988 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.510419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa4d6c-dcfa-4791-8ac9-0201da6f6988 None admin] PATH_INFO: `/v3/groups` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.511107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa4d6c-dcfa-4791-8ac9-0201da6f6988 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:36.512642 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa4d6c-dcfa-4791-8ac9-0201da6f6988 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:36.533588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb902b59-d635-4bed-a312-59d3d1fda054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:36.534465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902b59-d635-4bed-a312-59d3d1fda054 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.534748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902b59-d635-4bed-a312-59d3d1fda054 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.535021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902b59-d635-4bed-a312-59d3d1fda054 None admin] PATH_INFO: `/v3/users/a3f55817686e461ca356e7f7259c5c3d` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.536218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb902b59-d635-4bed-a312-59d3d1fda054 None admin] RBAC: Authorizing `identity:get_user(user_id=a3f55817686e461ca356e7f7259c5c3d)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:36.537667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb902b59-d635-4bed-a312-59d3d1fda054 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:36.539276 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 161/326] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:36 2022] GET /identity/v3/users/a3f55817686e461ca356e7f7259c5c3d => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:36.540474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848926a-ec92-41f9-8bcf-1d86f9a0402c None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.540755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848926a-ec92-41f9-8bcf-1d86f9a0402c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.541034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848926a-ec92-41f9-8bcf-1d86f9a0402c None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.542240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 162/327] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:36.546680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848926a-ec92-41f9-8bcf-1d86f9a0402c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:36.618637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 166/328] 10.222.0.46 () {60 vars in 1134 bytes} [Thu Jun 2 13:01:36 2022] POST /identity/v3/groups => generated 226 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:36.619991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d699f-de38-43ac-8d30-a773dd5db555 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.620278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d699f-de38-43ac-8d30-a773dd5db555 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.620555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d699f-de38-43ac-8d30-a773dd5db555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.645377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-402d699f-de38-43ac-8d30-a773dd5db555 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:36.646781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-402d699f-de38-43ac-8d30-a773dd5db555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:36.656368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848926a-ec92-41f9-8bcf-1d86f9a0402c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:36.688074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:36.695418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714a6ab-8673-4348-b88d-417f249a4457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:36.696343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714a6ab-8673-4348-b88d-417f249a4457 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.696628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714a6ab-8673-4348-b88d-417f249a4457 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.696907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714a6ab-8673-4348-b88d-417f249a4457 None admin] PATH_INFO: `/v3/system/users/a3f55817686e461ca356e7f7259c5c3d/roles/284d85c470f34ecd9485d00a62dffe68` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.698444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714a6ab-8673-4348-b88d-417f249a4457 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a3f55817686e461ca356e7f7259c5c3d, role_id=284d85c470f34ecd9485d00a62dffe68)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:36.699848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714a6ab-8673-4348-b88d-417f249a4457 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:36.725758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 167/329] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:36.749690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d699f-de38-43ac-8d30-a773dd5db555 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:36.779009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 163/330] 10.222.0.46 () {58 vars in 1334 bytes} [Thu Jun 2 13:01:36 2022] PUT /identity/v3/system/users/a3f55817686e461ca356e7f7259c5c3d/roles/284d85c470f34ecd9485d00a62dffe68 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:36.792840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:36.865757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d699f-de38-43ac-8d30-a773dd5db555 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:36.908656 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff50a7-59d8-495f-8168-199afd86cb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:36.909542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff50a7-59d8-495f-8168-199afd86cb6f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:36.909827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff50a7-59d8-495f-8168-199afd86cb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:36.910189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff50a7-59d8-495f-8168-199afd86cb6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:36.923322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff50a7-59d8-495f-8168-199afd86cb6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-7dff50a7-59d8-495f-8168-199afd86cb6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:36.931428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:36.932460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:36.933261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 168/331] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:36.940049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714a6ab-8673-4348-b88d-417f249a4457 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:37.058765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714a6ab-8673-4348-b88d-417f249a4457 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:37.094029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d7cad-766e-4f19-b85d-4644631c6e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:37.094706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d7cad-766e-4f19-b85d-4644631c6e5e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:37.094990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d7cad-766e-4f19-b85d-4644631c6e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:37.095263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d7cad-766e-4f19-b85d-4644631c6e5e None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:37.096041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d7cad-766e-4f19-b85d-4644631c6e5e None admin] RBAC: Adding query filter params (name=member) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:37.096345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d7cad-766e-4f19-b85d-4644631c6e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:37.097723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d7cad-766e-4f19-b85d-4644631c6e5e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:37.107116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 164/332] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:37.113001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff50a7-59d8-495f-8168-199afd86cb6f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:37.220670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:37.224234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff50a7-59d8-495f-8168-199afd86cb6f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:37.260334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5562ab7-ad35-4b99-a5fb-2bae7c4c2922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:37.261304 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5562ab7-ad35-4b99-a5fb-2bae7c4c2922 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:37.261510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5562ab7-ad35-4b99-a5fb-2bae7c4c2922 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:37.261785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5562ab7-ad35-4b99-a5fb-2bae7c4c2922 None admin] PATH_INFO: `/v3/users/ac57171453e444d1a44bc784ea108fa7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:37.263112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5562ab7-ad35-4b99-a5fb-2bae7c4c2922 None admin] RBAC: Authorizing `identity:get_user(user_id=ac57171453e444d1a44bc784ea108fa7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:37.265700 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5562ab7-ad35-4b99-a5fb-2bae7c4c2922 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:37.267674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 169/333] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:37 2022] GET /identity/v3/users/ac57171453e444d1a44bc784ea108fa7 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:37.273812 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d7cad-766e-4f19-b85d-4644631c6e5e None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:37.336617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:37.383379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d7cad-766e-4f19-b85d-4644631c6e5e None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:37.418730 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9a92a-3eae-4cab-aaf4-9246473e6ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:37.419395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9a92a-3eae-4cab-aaf4-9246473e6ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:37.419704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9a92a-3eae-4cab-aaf4-9246473e6ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:37.420012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9a92a-3eae-4cab-aaf4-9246473e6ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:37.420933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9a92a-3eae-4cab-aaf4-9246473e6ce7 None admin] RBAC: Adding query filter params (role.id=b35814b03f814680843c3aead86264f7, user.id=ac57171453e444d1a44bc784ea108fa7, scope.system=all) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:37.421305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9a92a-3eae-4cab-aaf4-9246473e6ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:37.422759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9a92a-3eae-4cab-aaf4-9246473e6ce7 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:37.438614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 165/334] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Jun 2 13:01:37 2022] GET /identity/v3/role_assignments?user.id=ac57171453e444d1a44bc784ea108fa7&scope.system=all&role.id=b35814b03f814680843c3aead86264f7 => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:39.247974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86126516-2b02-458b-a6a7-1779d3e39259 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:39.249053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86126516-2b02-458b-a6a7-1779d3e39259 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:39.249158 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86126516-2b02-458b-a6a7-1779d3e39259 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:39.250699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 170/335] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:39.257483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e69f2-152a-4472-a0cc-64b0f0e24a6f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:39.257960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e69f2-152a-4472-a0cc-64b0f0e24a6f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:39.258036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e69f2-152a-4472-a0cc-64b0f0e24a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:39.281248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d43e69f2-152a-4472-a0cc-64b0f0e24a6f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:39.282439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d43e69f2-152a-4472-a0cc-64b0f0e24a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:39.370560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 166/336] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:39.414432 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86126516-2b02-458b-a6a7-1779d3e39259 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:39.563431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86126516-2b02-458b-a6a7-1779d3e39259 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:39.603349 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afebf8-a46b-4a3d-a44c-1bb9ee0571a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:39.604189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afebf8-a46b-4a3d-a44c-1bb9ee0571a4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:39.604475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afebf8-a46b-4a3d-a44c-1bb9ee0571a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:39.604753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afebf8-a46b-4a3d-a44c-1bb9ee0571a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:39.621606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afebf8-a46b-4a3d-a44c-1bb9ee0571a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-b6afebf8-a46b-4a3d-a44c-1bb9ee0571a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:39.629660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:39.630665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:39.631931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 171/337] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:39.637000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e69f2-152a-4472-a0cc-64b0f0e24a6f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:39.671122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dbbd9-1762-49cb-913e-b7566e6555c4 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:39.671460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dbbd9-1762-49cb-913e-b7566e6555c4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:39.671686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dbbd9-1762-49cb-913e-b7566e6555c4 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:39.673103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 172/338] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:01:39.678494 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744294d-0ae6-435a-9321-777cf062f3ed None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:39.678783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744294d-0ae6-435a-9321-777cf062f3ed None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:39.679066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744294d-0ae6-435a-9321-777cf062f3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:39.706837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-b744294d-0ae6-435a-9321-777cf062f3ed None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:39.708088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b744294d-0ae6-435a-9321-777cf062f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:39.714206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:39.749555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:39.819983 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e69f2-152a-4472-a0cc-64b0f0e24a6f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:39.843298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 173/339] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:39.844728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46dea7-ea46-440d-8cf3-48cb24fe301b None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:39.845018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46dea7-ea46-440d-8cf3-48cb24fe301b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:39.845296 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46dea7-ea46-440d-8cf3-48cb24fe301b None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:39.846578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 174/340] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:39.852053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955385-e817-4096-8a13-0cbc431feb19 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:39.852341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955385-e817-4096-8a13-0cbc431feb19 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:39.852621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955385-e817-4096-8a13-0cbc431feb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:39.881053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-76955385-e817-4096-8a13-0cbc431feb19 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:39.882250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-76955385-e817-4096-8a13-0cbc431feb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:39.886677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8ab5f-bac8-48a9-a45f-e6f2dace2197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:39.887358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8ab5f-bac8-48a9-a45f-e6f2dace2197 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:39.887641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8ab5f-bac8-48a9-a45f-e6f2dace2197 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:39.887937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8ab5f-bac8-48a9-a45f-e6f2dace2197 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:39.888704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8ab5f-bac8-48a9-a45f-e6f2dace2197 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:39.889548 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8ab5f-bac8-48a9-a45f-e6f2dace2197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:39.890942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8ab5f-bac8-48a9-a45f-e6f2dace2197 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:39.907217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 167/341] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:39.908123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8ab5f-bac8-48a9-a45f-e6f2dace2197 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:40.125815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 175/342] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:40.126714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76955385-e817-4096-8a13-0cbc431feb19 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:40.132659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8ab5f-bac8-48a9-a45f-e6f2dace2197 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:40.144327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:40.199294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae37dc-870b-49dc-bab1-7f1bb54fafc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:40.200148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae37dc-870b-49dc-bab1-7f1bb54fafc2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:40.200437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae37dc-870b-49dc-bab1-7f1bb54fafc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:40.200716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae37dc-870b-49dc-bab1-7f1bb54fafc2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:40.216215 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae37dc-870b-49dc-bab1-7f1bb54fafc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-3eae37dc-870b-49dc-bab1-7f1bb54fafc2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:40.225437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:40.226335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:40.227110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:40.229118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 168/343] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:40.232372 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae37dc-870b-49dc-bab1-7f1bb54fafc2 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:40.272465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:40.298891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76955385-e817-4096-8a13-0cbc431feb19 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:40.360740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b9b67-c618-49ed-80b4-f5876891ba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:40.361654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b9b67-c618-49ed-80b4-f5876891ba0e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:40.361936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b9b67-c618-49ed-80b4-f5876891ba0e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:40.362224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b9b67-c618-49ed-80b4-f5876891ba0e None admin] PATH_INFO: `/v3/users/a3f55817686e461ca356e7f7259c5c3d` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:40.363519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b9b67-c618-49ed-80b4-f5876891ba0e None admin] RBAC: Authorizing `identity:get_user(user_id=a3f55817686e461ca356e7f7259c5c3d)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:40.365104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b9b67-c618-49ed-80b4-f5876891ba0e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:40.367402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 176/344] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:01:40 2022] GET /identity/v3/users/a3f55817686e461ca356e7f7259c5c3d => generated 293 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:40.368257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b9b67-c618-49ed-80b4-f5876891ba0e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:40.413026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae37dc-870b-49dc-bab1-7f1bb54fafc2 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:40.459558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248749e-f1eb-4cc0-a3b9-030852a4ba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:40.460457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248749e-f1eb-4cc0-a3b9-030852a4ba56 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:40.460747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248749e-f1eb-4cc0-a3b9-030852a4ba56 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:40.461027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248749e-f1eb-4cc0-a3b9-030852a4ba56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:40.472354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248749e-f1eb-4cc0-a3b9-030852a4ba56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-b248749e-f1eb-4cc0-a3b9-030852a4ba56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:40.480895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:40.481822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:40.483158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 169/345] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:40.484452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25764d27-d87c-4ecc-928e-b5a656025441 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:40.484452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25764d27-d87c-4ecc-928e-b5a656025441 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:40.484686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25764d27-d87c-4ecc-928e-b5a656025441 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:40.485945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 170/346] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:40.486658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25764d27-d87c-4ecc-928e-b5a656025441 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:40.505675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b9b67-c618-49ed-80b4-f5876891ba0e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:40.521195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:40.545651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f15000-afe5-45fe-bfe9-7b11186af3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:40.546691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15000-afe5-45fe-bfe9-7b11186af3ce None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:40.547174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15000-afe5-45fe-bfe9-7b11186af3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:40.547676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15000-afe5-45fe-bfe9-7b11186af3ce None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:40.548662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15000-afe5-45fe-bfe9-7b11186af3ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:40.549181 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15000-afe5-45fe-bfe9-7b11186af3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:40.550766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15000-afe5-45fe-bfe9-7b11186af3ce None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:40.559672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 177/347] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:40.561676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f15000-afe5-45fe-bfe9-7b11186af3ce None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:40.580896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:40.608554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25764d27-d87c-4ecc-928e-b5a656025441 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:40.646815 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfd6fb-2c04-4ed3-971a-59694c739890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:40.647530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfd6fb-2c04-4ed3-971a-59694c739890 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:40.647762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfd6fb-2c04-4ed3-971a-59694c739890 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:40.648073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfd6fb-2c04-4ed3-971a-59694c739890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:40.648911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfd6fb-2c04-4ed3-971a-59694c739890 None admin] RBAC: Adding query filter params (role.id=284d85c470f34ecd9485d00a62dffe68, user.id=a3f55817686e461ca356e7f7259c5c3d, scope.system=all) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:40.649226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfd6fb-2c04-4ed3-971a-59694c739890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:40.650809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfd6fb-2c04-4ed3-971a-59694c739890 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:40.669982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 171/348] 10.222.0.46 () {56 vars in 1308 bytes} [Thu Jun 2 13:01:40 2022] GET /identity/v3/role_assignments?user.id=a3f55817686e461ca356e7f7259c5c3d&scope.system=all&role.id=284d85c470f34ecd9485d00a62dffe68 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:40.669982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660794-a1d5-46d3-9fd1-b893b963f916 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:40.669982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660794-a1d5-46d3-9fd1-b893b963f916 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:40.669982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2660794-a1d5-46d3-9fd1-b893b963f916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:40.690029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c2660794-a1d5-46d3-9fd1-b893b963f916 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:40.691246 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c2660794-a1d5-46d3-9fd1-b893b963f916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:40.708163 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f15000-afe5-45fe-bfe9-7b11186af3ce None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:40.775900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 172/349] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:40.775900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660794-a1d5-46d3-9fd1-b893b963f916 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:40.785649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f07064-0819-4462-9d8c-c6df3bdaab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:40.786717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07064-0819-4462-9d8c-c6df3bdaab6e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:40.787222 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07064-0819-4462-9d8c-c6df3bdaab6e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:40.787709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07064-0819-4462-9d8c-c6df3bdaab6e None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:40.788731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f07064-0819-4462-9d8c-c6df3bdaab6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:40.789268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f07064-0819-4462-9d8c-c6df3bdaab6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:40.790912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f07064-0819-4462-9d8c-c6df3bdaab6e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:40.804348 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:40.806042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 178/350] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:40.812727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f07064-0819-4462-9d8c-c6df3bdaab6e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:40.910446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:40.913249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2660794-a1d5-46d3-9fd1-b893b963f916 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:40.934702 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f07064-0819-4462-9d8c-c6df3bdaab6e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:40.949672 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d8665-44e6-4d35-9960-d1cf7748cec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:40.950355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8665-44e6-4d35-9960-d1cf7748cec5 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:40.950614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8665-44e6-4d35-9960-d1cf7748cec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:40.950888 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8665-44e6-4d35-9960-d1cf7748cec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:40.975045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889765-a3da-4a38-a464-536b0f04b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:40.976186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889765-a3da-4a38-a464-536b0f04b435 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:40.976748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889765-a3da-4a38-a464-536b0f04b435 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:40.977221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889765-a3da-4a38-a464-536b0f04b435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.031752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d8665-44e6-4d35-9960-d1cf7748cec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:41.033268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d8665-44e6-4d35-9960-d1cf7748cec5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:41.049207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:41.062697 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81889765-a3da-4a38-a464-536b0f04b435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:41.064673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81889765-a3da-4a38-a464-536b0f04b435 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:41.144843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 173/351] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:41.145734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d8665-44e6-4d35-9960-d1cf7748cec5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:41.172361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:41.196191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 179/352] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:41.197590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889765-a3da-4a38-a464-536b0f04b435 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:41.262078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d8665-44e6-4d35-9960-d1cf7748cec5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:41.278132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:41.298891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9e5ab-4442-452f-bb61-b9fa6af3b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:41.299642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9e5ab-4442-452f-bb61-b9fa6af3b180 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:41.299983 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9e5ab-4442-452f-bb61-b9fa6af3b180 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:41.300258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9e5ab-4442-452f-bb61-b9fa6af3b180 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.313773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9e5ab-4442-452f-bb61-b9fa6af3b180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:41.318638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889765-a3da-4a38-a464-536b0f04b435 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-d2c9e5ab-4442-452f-bb61-b9fa6af3b180 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:41.323253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:41.324184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 174/353] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:41.324970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9e5ab-4442-452f-bb61-b9fa6af3b180 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:41.361389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921e71e-c593-4839-aead-b50452530338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:41.362921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e71e-c593-4839-aead-b50452530338 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:41.363519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e71e-c593-4839-aead-b50452530338 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:41.364036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e71e-c593-4839-aead-b50452530338 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.365548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921e71e-c593-4839-aead-b50452530338 None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:41.367698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921e71e-c593-4839-aead-b50452530338 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:41.370101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 180/354] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:41 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:41.371111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921e71e-c593-4839-aead-b50452530338 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:41.428383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:41.456832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9e5ab-4442-452f-bb61-b9fa6af3b180 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:41.487184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921e71e-c593-4839-aead-b50452530338 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:41.494999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8146-2f9a-44f3-961a-4b5cecaec5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:41.496202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8146-2f9a-44f3-961a-4b5cecaec5fb None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:41.496646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8146-2f9a-44f3-961a-4b5cecaec5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:41.497111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8146-2f9a-44f3-961a-4b5cecaec5fb None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.498718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f8146-2f9a-44f3-961a-4b5cecaec5fb None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:41.500482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f8146-2f9a-44f3-961a-4b5cecaec5fb None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:41.503831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 175/355] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:41 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:41.505054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8146-2f9a-44f3-961a-4b5cecaec5fb None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:41.531690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215a95e-8402-4e79-8a78-b3280f2c3d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:41.532716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215a95e-8402-4e79-8a78-b3280f2c3d00 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:41.533011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215a95e-8402-4e79-8a78-b3280f2c3d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:41.533301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215a95e-8402-4e79-8a78-b3280f2c3d00 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.534094 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215a95e-8402-4e79-8a78-b3280f2c3d00 None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:41.534400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215a95e-8402-4e79-8a78-b3280f2c3d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:41.535998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215a95e-8402-4e79-8a78-b3280f2c3d00 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:41.545179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 181/356] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:41.546050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215a95e-8402-4e79-8a78-b3280f2c3d00 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:41.559060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:41.629552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8146-2f9a-44f3-961a-4b5cecaec5fb None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:41.663700 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215a95e-8402-4e79-8a78-b3280f2c3d00 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:41.673922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ecdda-a390-483c-b6f8-cd6a886713db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:41.674793 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ecdda-a390-483c-b6f8-cd6a886713db None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:41.675080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ecdda-a390-483c-b6f8-cd6a886713db None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:41.675545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ecdda-a390-483c-b6f8-cd6a886713db None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.676283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:41.682144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ecdda-a390-483c-b6f8-cd6a886713db None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:41.683416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ecdda-a390-483c-b6f8-cd6a886713db None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:41.685380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 176/357] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:41 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:41.687096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678852bc-a2dc-4f98-b6e7-6b9eb3e24d11 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:41.688194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678852bc-a2dc-4f98-b6e7-6b9eb3e24d11 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:41.688194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678852bc-a2dc-4f98-b6e7-6b9eb3e24d11 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.694728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 177/358] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:41.694728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678852bc-a2dc-4f98-b6e7-6b9eb3e24d11 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:41.718553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96e73-ce6c-44c8-8708-a2a75ba8a967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:41.720031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96e73-ce6c-44c8-8708-a2a75ba8a967 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:41.721644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96e73-ce6c-44c8-8708-a2a75ba8a967 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:41.721933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96e73-ce6c-44c8-8708-a2a75ba8a967 None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.723179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe96e73-ce6c-44c8-8708-a2a75ba8a967 None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:41.724716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe96e73-ce6c-44c8-8708-a2a75ba8a967 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:41.726542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 182/359] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:41 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:41.727153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96e73-ce6c-44c8-8708-a2a75ba8a967 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:41.828065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678852bc-a2dc-4f98-b6e7-6b9eb3e24d11 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:41.835859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:41.863468 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96e73-ce6c-44c8-8708-a2a75ba8a967 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:41.866469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eb57c-e91b-4314-97d7-512f08612ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:41.867390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eb57c-e91b-4314-97d7-512f08612ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:41.867698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eb57c-e91b-4314-97d7-512f08612ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:41.868062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eb57c-e91b-4314-97d7-512f08612ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.906001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251483-be87-47b8-b055-b9766c8c3212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:41.907052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251483-be87-47b8-b055-b9766c8c3212 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:41.907344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251483-be87-47b8-b055-b9766c8c3212 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:41.907622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251483-be87-47b8-b055-b9766c8c3212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.908514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251483-be87-47b8-b055-b9766c8c3212 None admin] RBAC: Adding query filter params (group.id=92d60313beb14ddba820e58797390054, role.id=c0027060d6364e5e9bd9c2cb5ad9788f, scope.project.id=54da9f11da824072acb54f348da7e461) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:41.908837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251483-be87-47b8-b055-b9766c8c3212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:41.910282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251483-be87-47b8-b055-b9766c8c3212 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:41.917972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 183/360] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Jun 2 13:01:41 2022] GET /identity/v3/role_assignments?group.id=92d60313beb14ddba820e58797390054&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=c0027060d6364e5e9bd9c2cb5ad9788f => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:41.919079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61caa-85de-4e5a-92a8-9dfe99b566b6 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:41.919374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61caa-85de-4e5a-92a8-9dfe99b566b6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:41.919655 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61caa-85de-4e5a-92a8-9dfe99b566b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:41.937703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-28d61caa-85de-4e5a-92a8-9dfe99b566b6 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:41.939181 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-28d61caa-85de-4e5a-92a8-9dfe99b566b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:41.950130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eb57c-e91b-4314-97d7-512f08612ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:41.951339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eb57c-e91b-4314-97d7-512f08612ee7 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:41.997518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:42.044200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 184/361] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:42.049758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61caa-85de-4e5a-92a8-9dfe99b566b6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:42.086043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 178/362] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:42.087539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8cade-b951-47ce-b911-34e8b04e7a0c None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:42.087539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8cade-b951-47ce-b911-34e8b04e7a0c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:42.087802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8cade-b951-47ce-b911-34e8b04e7a0c None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:42.089340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 179/363] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:42.089959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8cade-b951-47ce-b911-34e8b04e7a0c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:42.100155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:42.185696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61caa-85de-4e5a-92a8-9dfe99b566b6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:42.234789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8cade-b951-47ce-b911-34e8b04e7a0c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:42.237617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015306b3-28b0-4e39-adb2-e1173299edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:42.238289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015306b3-28b0-4e39-adb2-e1173299edfc None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:42.238587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015306b3-28b0-4e39-adb2-e1173299edfc None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:42.238919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015306b3-28b0-4e39-adb2-e1173299edfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:42.239833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015306b3-28b0-4e39-adb2-e1173299edfc None admin] RBAC: Adding query filter params (group.id=92d60313beb14ddba820e58797390054, role.id=b35814b03f814680843c3aead86264f7, scope.project.id=54da9f11da824072acb54f348da7e461) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:42.240177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015306b3-28b0-4e39-adb2-e1173299edfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:42.241680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015306b3-28b0-4e39-adb2-e1173299edfc None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:42.249706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 185/364] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Jun 2 13:01:42 2022] GET /identity/v3/role_assignments?group.id=92d60313beb14ddba820e58797390054&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=b35814b03f814680843c3aead86264f7 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:42.251419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015306b3-28b0-4e39-adb2-e1173299edfc None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:42.282004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c0c10-e873-4714-8108-ee0da5d6c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:42.283179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0c10-e873-4714-8108-ee0da5d6c812 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:42.283665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0c10-e873-4714-8108-ee0da5d6c812 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:42.284250 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0c10-e873-4714-8108-ee0da5d6c812 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:42.297861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:42.298958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c0c10-e873-4714-8108-ee0da5d6c812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-f37c0c10-e873-4714-8108-ee0da5d6c812 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:42.307790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:42.308792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:42.309587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:42.312898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 180/365] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:42.320328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29258a-cadb-42a4-9e52-dd1ef74f0f09 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:42.320328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29258a-cadb-42a4-9e52-dd1ef74f0f09 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:42.320328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29258a-cadb-42a4-9e52-dd1ef74f0f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:42.336969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-3e29258a-cadb-42a4-9e52-dd1ef74f0f09 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:42.338611 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3e29258a-cadb-42a4-9e52-dd1ef74f0f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:42.386688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015306b3-28b0-4e39-adb2-e1173299edfc None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:42.433023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:42.443498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed375-dd1f-4af9-97e1-ce8e322f7605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:42.447840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed375-dd1f-4af9-97e1-ce8e322f7605 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:42.447840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed375-dd1f-4af9-97e1-ce8e322f7605 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:42.447840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed375-dd1f-4af9-97e1-ce8e322f7605 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:42.448150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 181/366] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:42.448237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed375-dd1f-4af9-97e1-ce8e322f7605 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:42.448325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29258a-cadb-42a4-9e52-dd1ef74f0f09 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:42.448406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed375-dd1f-4af9-97e1-ce8e322f7605 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:42.454811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 186/367] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:42 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:42.462631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed375-dd1f-4af9-97e1-ce8e322f7605 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:42.586061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29258a-cadb-42a4-9e52-dd1ef74f0f09 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:42.595395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed375-dd1f-4af9-97e1-ce8e322f7605 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:42.597712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:42.632546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd735742-b15f-4869-8672-e6316c351f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:42.633270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd735742-b15f-4869-8672-e6316c351f3b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:42.633559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd735742-b15f-4869-8672-e6316c351f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:42.633896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd735742-b15f-4869-8672-e6316c351f3b None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:42.634625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd735742-b15f-4869-8672-e6316c351f3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:42.634930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd735742-b15f-4869-8672-e6316c351f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:42.636403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd735742-b15f-4869-8672-e6316c351f3b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:42.650292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 182/368] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:42.650292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd735742-b15f-4869-8672-e6316c351f3b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:42.651126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b912e2-ff01-4856-a6c0-c437067e1d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:42.654287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b912e2-ff01-4856-a6c0-c437067e1d22 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:42.654780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b912e2-ff01-4856-a6c0-c437067e1d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:42.655197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b912e2-ff01-4856-a6c0-c437067e1d22 None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:42.657018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b912e2-ff01-4856-a6c0-c437067e1d22 None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:42.658662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b912e2-ff01-4856-a6c0-c437067e1d22 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:42.662197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 187/369] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:42 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:42.663157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b912e2-ff01-4856-a6c0-c437067e1d22 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:42.725157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:42.779653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd735742-b15f-4869-8672-e6316c351f3b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:42.796311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b912e2-ff01-4856-a6c0-c437067e1d22 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:42.824474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893ed34-19d3-4439-b5ee-25020ed34a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:42.825550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893ed34-19d3-4439-b5ee-25020ed34a68 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:42.825838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893ed34-19d3-4439-b5ee-25020ed34a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:42.826139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893ed34-19d3-4439-b5ee-25020ed34a68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:42.840190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893ed34-19d3-4439-b5ee-25020ed34a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:42.840468 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566456e4-3bec-4a1e-b1e3-d6b37f2cc34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:42.841133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566456e4-3bec-4a1e-b1e3-d6b37f2cc34f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:42.841417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566456e4-3bec-4a1e-b1e3-d6b37f2cc34f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:42.841696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566456e4-3bec-4a1e-b1e3-d6b37f2cc34f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-b893ed34-19d3-4439-b5ee-25020ed34a68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:42.849325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:42.850223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:42.851046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 183/370] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:01:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:42.852725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893ed34-19d3-4439-b5ee-25020ed34a68 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:42.893925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:42.926251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566456e4-3bec-4a1e-b1e3-d6b37f2cc34f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:42.927721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566456e4-3bec-4a1e-b1e3-d6b37f2cc34f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:42.990962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893ed34-19d3-4439-b5ee-25020ed34a68 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:43.011649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:43.032815 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057d3c5-2dc7-4661-9962-8b4a7833f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:43.033650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057d3c5-2dc7-4661-9962-8b4a7833f855 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:43.033996 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057d3c5-2dc7-4661-9962-8b4a7833f855 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:43.034280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057d3c5-2dc7-4661-9962-8b4a7833f855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:43.035112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057d3c5-2dc7-4661-9962-8b4a7833f855 None admin] RBAC: Adding query filter params (group.id=92d60313beb14ddba820e58797390054, role.id=b35814b03f814680843c3aead86264f7, scope.project.id=d287700518a644f8bd9772318b8e8e0e) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:43.035424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057d3c5-2dc7-4661-9962-8b4a7833f855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:43.036974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057d3c5-2dc7-4661-9962-8b4a7833f855 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:43.047513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 184/371] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Jun 2 13:01:42 2022] GET /identity/v3/role_assignments?group.id=92d60313beb14ddba820e58797390054&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=b35814b03f814680843c3aead86264f7 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:43.047513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057d3c5-2dc7-4661-9962-8b4a7833f855 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:43.068187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 188/372] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:43.072774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566456e4-3bec-4a1e-b1e3-d6b37f2cc34f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:43.148301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:43.164737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057d3c5-2dc7-4661-9962-8b4a7833f855 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:43.183550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566456e4-3bec-4a1e-b1e3-d6b37f2cc34f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:43.227516 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a532763-7147-4ed1-8213-2c3f90a5d0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:43.228969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9db08-b04c-4f13-8572-f252623e1df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:43.230051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a532763-7147-4ed1-8213-2c3f90a5d0ef None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:43.230881 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9db08-b04c-4f13-8572-f252623e1df8 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:43.231305 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a532763-7147-4ed1-8213-2c3f90a5d0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:43.231731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9db08-b04c-4f13-8572-f252623e1df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:43.232159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a532763-7147-4ed1-8213-2c3f90a5d0ef None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:43.232607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9db08-b04c-4f13-8572-f252623e1df8 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:43.234176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9db08-b04c-4f13-8572-f252623e1df8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:43.235041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a532763-7147-4ed1-8213-2c3f90a5d0ef None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:43.235510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9db08-b04c-4f13-8572-f252623e1df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:43.237132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9db08-b04c-4f13-8572-f252623e1df8 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:43.238813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a532763-7147-4ed1-8213-2c3f90a5d0ef None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:43.248786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 189/373] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:43 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:43.253690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a532763-7147-4ed1-8213-2c3f90a5d0ef None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:43.266798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 185/374] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:43.272830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9db08-b04c-4f13-8572-f252623e1df8 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:43.354139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:43.400833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a532763-7147-4ed1-8213-2c3f90a5d0ef None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:43.432382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9db08-b04c-4f13-8572-f252623e1df8 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:43.444023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa51ca9-7f2f-4a39-b9f9-27121ee445ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:43.444904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa51ca9-7f2f-4a39-b9f9-27121ee445ad None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:43.445186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa51ca9-7f2f-4a39-b9f9-27121ee445ad None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:43.445460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa51ca9-7f2f-4a39-b9f9-27121ee445ad None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:43.452651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa51ca9-7f2f-4a39-b9f9-27121ee445ad None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:43.454223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa51ca9-7f2f-4a39-b9f9-27121ee445ad None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:43.456380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 190/375] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:43 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:43.466233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa51ca9-7f2f-4a39-b9f9-27121ee445ad None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:43.478781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d944-440e-4c5c-81b2-45810e4924cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:43.479450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d944-440e-4c5c-81b2-45810e4924cf None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:43.479735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d944-440e-4c5c-81b2-45810e4924cf None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:43.481766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16d944-440e-4c5c-81b2-45810e4924cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:43.483260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:43.633077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16d944-440e-4c5c-81b2-45810e4924cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:43.634600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16d944-440e-4c5c-81b2-45810e4924cf None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:43.645324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa51ca9-7f2f-4a39-b9f9-27121ee445ad None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:43.687188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883c34-e83d-4990-b63e-26645e12604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:43.688359 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883c34-e83d-4990-b63e-26645e12604d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:43.688646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883c34-e83d-4990-b63e-26645e12604d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:43.688924 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883c34-e83d-4990-b63e-26645e12604d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:43.689775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883c34-e83d-4990-b63e-26645e12604d None admin] RBAC: Adding query filter params (group.id=92d60313beb14ddba820e58797390054, role.id=c0027060d6364e5e9bd9c2cb5ad9788f, scope.project.id=d287700518a644f8bd9772318b8e8e0e) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:43.690092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883c34-e83d-4990-b63e-26645e12604d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:43.691572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883c34-e83d-4990-b63e-26645e12604d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:43.698156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 191/376] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Jun 2 13:01:43 2022] GET /identity/v3/role_assignments?group.id=92d60313beb14ddba820e58797390054&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=c0027060d6364e5e9bd9c2cb5ad9788f => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:43.752907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:43.817934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 186/377] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:43.823822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883c34-e83d-4990-b63e-26645e12604d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:43.902800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:43.938967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883c34-e83d-4990-b63e-26645e12604d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:43.983090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4034aa-21a2-42a0-9b62-c078f8b8ec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:43.984259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4034aa-21a2-42a0-9b62-c078f8b8ec78 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:43.984706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4034aa-21a2-42a0-9b62-c078f8b8ec78 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:43.985123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4034aa-21a2-42a0-9b62-c078f8b8ec78 None admin] PATH_INFO: `/v3/projects/4046aee9673645e2803f9186d9e29f17` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:43.986515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4034aa-21a2-42a0-9b62-c078f8b8ec78 None admin] RBAC: Authorizing `identity:get_project(project_id=4046aee9673645e2803f9186d9e29f17)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:43.988151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4034aa-21a2-42a0-9b62-c078f8b8ec78 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:43.990302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 192/378] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:43 2022] GET /identity/v3/projects/4046aee9673645e2803f9186d9e29f17 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:43.996123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d944-440e-4c5c-81b2-45810e4924cf None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:44.115749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16d944-440e-4c5c-81b2-45810e4924cf None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:44.162947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d126532-a286-4545-85e0-97992995be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:44.164131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d126532-a286-4545-85e0-97992995be8e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:44.164564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d126532-a286-4545-85e0-97992995be8e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:44.165001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d126532-a286-4545-85e0-97992995be8e None admin] PATH_INFO: `/v3/groups/7a23c7a38a9049f5900feff6a719389c` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:44.170837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d126532-a286-4545-85e0-97992995be8e None admin] RBAC: Authorizing `identity:get_group(group_id=7a23c7a38a9049f5900feff6a719389c)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:44.172557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d126532-a286-4545-85e0-97992995be8e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:44.174697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 187/379] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:43 2022] GET /identity/v3/groups/7a23c7a38a9049f5900feff6a719389c => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:44.180624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4034aa-21a2-42a0-9b62-c078f8b8ec78 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:44.288386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4034aa-21a2-42a0-9b62-c078f8b8ec78 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:44.331290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52c7f6-3083-4a8f-9ffd-4a374d4776d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:44.332308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c7f6-3083-4a8f-9ffd-4a374d4776d7 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:44.332741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c7f6-3083-4a8f-9ffd-4a374d4776d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:44.333164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c7f6-3083-4a8f-9ffd-4a374d4776d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:44.334179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c7f6-3083-4a8f-9ffd-4a374d4776d7 None admin] RBAC: Adding query filter params (group.id=7a23c7a38a9049f5900feff6a719389c, role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=4046aee9673645e2803f9186d9e29f17) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:44.334641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c7f6-3083-4a8f-9ffd-4a374d4776d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:44.336340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c7f6-3083-4a8f-9ffd-4a374d4776d7 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:44.343156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 193/380] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Jun 2 13:01:44 2022] GET /identity/v3/role_assignments?group.id=7a23c7a38a9049f5900feff6a719389c&scope.project.id=4046aee9673645e2803f9186d9e29f17&role.id=31c5600d1f984a04827cf0052fc61678 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:44.748790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b8191-75de-42db-8db9-40f315ccc874 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:44.749842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b8191-75de-42db-8db9-40f315ccc874 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:44.750385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b8191-75de-42db-8db9-40f315ccc874 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:44.752008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 188/381] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:44.757470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72bf5b-9f23-4788-ac95-8623d43132bc None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:44.758321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72bf5b-9f23-4788-ac95-8623d43132bc None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:44.758804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72bf5b-9f23-4788-ac95-8623d43132bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:44.765665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:44.780904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3f72bf5b-9f23-4788-ac95-8623d43132bc None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:44.784734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3f72bf5b-9f23-4788-ac95-8623d43132bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:44.869574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 194/382] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:44.900735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b8191-75de-42db-8db9-40f315ccc874 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:44.912379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:45.028262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b8191-75de-42db-8db9-40f315ccc874 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:45.069939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b7847-77b3-4508-8452-160771c7023e None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:45.070267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b7847-77b3-4508-8452-160771c7023e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:45.070509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b7847-77b3-4508-8452-160771c7023e None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:45.072167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 195/383] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:45.075987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b077c-047e-4cd6-8278-cb4fb694d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:45.077341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b077c-047e-4cd6-8278-cb4fb694d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:45.077625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b077c-047e-4cd6-8278-cb4fb694d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:45.077901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b077c-047e-4cd6-8278-cb4fb694d0e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:45.093640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b077c-047e-4cd6-8278-cb4fb694d0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:45.098212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e214c89-4b6b-4409-9d04-3dfc0db39551 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:45.098469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e214c89-4b6b-4409-9d04-3dfc0db39551 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:45.098753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e214c89-4b6b-4409-9d04-3dfc0db39551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-0d0b077c-047e-4cd6-8278-cb4fb694d0e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:45.105716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:45.106607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:45.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:45.112065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 189/384] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:45.116331 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b077c-047e-4cd6-8278-cb4fb694d0e7 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:45.134188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-2e214c89-4b6b-4409-9d04-3dfc0db39551 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:45.134188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2e214c89-4b6b-4409-9d04-3dfc0db39551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:45.195090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:45.238444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b077c-047e-4cd6-8278-cb4fb694d0e7 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:45.242507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 196/385] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:45.278095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e214c89-4b6b-4409-9d04-3dfc0db39551 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:45.282024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a952c33-e59f-439e-b566-47069972170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:45.283010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a952c33-e59f-439e-b566-47069972170c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:45.283488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a952c33-e59f-439e-b566-47069972170c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:45.283997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a952c33-e59f-439e-b566-47069972170c None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:45.284948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a952c33-e59f-439e-b566-47069972170c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:45.285448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a952c33-e59f-439e-b566-47069972170c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:45.287223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a952c33-e59f-439e-b566-47069972170c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:45.302566 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 190/386] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:45.308346 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a952c33-e59f-439e-b566-47069972170c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:45.348512 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:45.392855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e214c89-4b6b-4409-9d04-3dfc0db39551 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:45.428215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221c458-96c5-4b74-9d9c-578b5d5e9fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:45.429038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221c458-96c5-4b74-9d9c-578b5d5e9fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:45.429327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221c458-96c5-4b74-9d9c-578b5d5e9fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:45.429608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221c458-96c5-4b74-9d9c-578b5d5e9fb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:45.441058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221c458-96c5-4b74-9d9c-578b5d5e9fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:45.450456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a952c33-e59f-439e-b566-47069972170c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-4221c458-96c5-4b74-9d9c-578b5d5e9fb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:45.452968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:45.453848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:45.454721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 197/387] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:45.461518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221c458-96c5-4b74-9d9c-578b5d5e9fb7 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:45.482267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:45.494446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f4414-55d7-482a-9bae-bc1423455b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:45.496432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f4414-55d7-482a-9bae-bc1423455b47 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:45.496432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f4414-55d7-482a-9bae-bc1423455b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:45.497172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f4414-55d7-482a-9bae-bc1423455b47 None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:45.501705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f4414-55d7-482a-9bae-bc1423455b47 None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:45.503772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f4414-55d7-482a-9bae-bc1423455b47 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:45.508799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 191/388] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:45 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:45.513665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f4414-55d7-482a-9bae-bc1423455b47 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:45.649931 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f4414-55d7-482a-9bae-bc1423455b47 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:45.673676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221c458-96c5-4b74-9d9c-578b5d5e9fb7 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:45.701762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2edae4-b2d7-4964-a1af-39b18c66608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:45.702643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2edae4-b2d7-4964-a1af-39b18c66608d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:45.702921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2edae4-b2d7-4964-a1af-39b18c66608d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:45.703294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2edae4-b2d7-4964-a1af-39b18c66608d None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:45.706093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:45.707629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2edae4-b2d7-4964-a1af-39b18c66608d None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:45.709136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2edae4-b2d7-4964-a1af-39b18c66608d None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:45.711030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 192/389] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:45 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:45.718170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2edae4-b2d7-4964-a1af-39b18c66608d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:45.739814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c91d2-0b82-4cab-9170-54df013d13d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:45.740592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c91d2-0b82-4cab-9170-54df013d13d9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:45.740869 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c91d2-0b82-4cab-9170-54df013d13d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:45.741195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c91d2-0b82-4cab-9170-54df013d13d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:45.745229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c91d2-0b82-4cab-9170-54df013d13d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:45.746501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c91d2-0b82-4cab-9170-54df013d13d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:45.748755 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c91d2-0b82-4cab-9170-54df013d13d9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:45.768039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 198/390] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:45.774129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c91d2-0b82-4cab-9170-54df013d13d9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:45.891749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:45.923229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c91d2-0b82-4cab-9170-54df013d13d9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:45.965718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e18af-a424-4906-b4c6-096e99af7886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:45.967662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e18af-a424-4906-b4c6-096e99af7886 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:45.968200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e18af-a424-4906-b4c6-096e99af7886 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:45.968693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e18af-a424-4906-b4c6-096e99af7886 None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:45.970259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e18af-a424-4906-b4c6-096e99af7886 None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:45.972020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e18af-a424-4906-b4c6-096e99af7886 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:45.974363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 199/391] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:45 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:45.979450 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e18af-a424-4906-b4c6-096e99af7886 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:45.994403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2edae4-b2d7-4964-a1af-39b18c66608d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:46.043788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:46.070107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def90ac-307d-4e19-ada6-a0a07d73295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:46.071009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def90ac-307d-4e19-ada6-a0a07d73295b None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:46.071296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def90ac-307d-4e19-ada6-a0a07d73295b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:46.071577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def90ac-307d-4e19-ada6-a0a07d73295b None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461/groups/92d60313beb14ddba820e58797390054/roles/c0027060d6364e5e9bd9c2cb5ad9788f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:46.073913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def90ac-307d-4e19-ada6-a0a07d73295b None admin] RBAC: Authorizing `identity:create_grant(project_id=54da9f11da824072acb54f348da7e461, group_id=92d60313beb14ddba820e58797390054, role_id=c0027060d6364e5e9bd9c2cb5ad9788f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:46.075385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def90ac-307d-4e19-ada6-a0a07d73295b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:46.116338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e18af-a424-4906-b4c6-096e99af7886 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:46.158621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c3b83-96d7-482b-a8d9-4517d74d6f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:46.159921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c3b83-96d7-482b-a8d9-4517d74d6f6f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:46.160400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c3b83-96d7-482b-a8d9-4517d74d6f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:46.160863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c3b83-96d7-482b-a8d9-4517d74d6f6f None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:46.162403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c3b83-96d7-482b-a8d9-4517d74d6f6f None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:46.164151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c3b83-96d7-482b-a8d9-4517d74d6f6f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:46.166994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 200/392] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:45 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:46.168540 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a104b-faa1-40c6-8581-c082d5967b0a None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:46.169043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a104b-faa1-40c6-8581-c082d5967b0a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:46.169612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a104b-faa1-40c6-8581-c082d5967b0a None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:46.171550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 201/393] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:46.172511 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a104b-faa1-40c6-8581-c082d5967b0a None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:46.209582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 193/394] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Jun 2 13:01:45 2022] PUT /identity/v3/projects/54da9f11da824072acb54f348da7e461/groups/92d60313beb14ddba820e58797390054/roles/c0027060d6364e5e9bd9c2cb5ad9788f => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:46.211149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b0c0-95b6-4507-a107-5f8f2dd6e1de None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:46.211625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b0c0-95b6-4507-a107-5f8f2dd6e1de None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:46.212139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b0c0-95b6-4507-a107-5f8f2dd6e1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:46.254602 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9788b0c0-95b6-4507-a107-5f8f2dd6e1de None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:46.257443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9788b0c0-95b6-4507-a107-5f8f2dd6e1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:46.375621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a104b-faa1-40c6-8581-c082d5967b0a None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:46.418210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:46.438425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521779d-8b25-46b5-a367-40afb24b54b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:46.439902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521779d-8b25-46b5-a367-40afb24b54b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:46.440512 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521779d-8b25-46b5-a367-40afb24b54b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:46.441086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521779d-8b25-46b5-a367-40afb24b54b8 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461/groups/92d60313beb14ddba820e58797390054/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:46.443716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521779d-8b25-46b5-a367-40afb24b54b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=54da9f11da824072acb54f348da7e461, group_id=92d60313beb14ddba820e58797390054, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:46.445618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521779d-8b25-46b5-a367-40afb24b54b8 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:46.459708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 194/395] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:46.487399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788b0c0-95b6-4507-a107-5f8f2dd6e1de None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:46.550325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 202/396] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Jun 2 13:01:46 2022] PUT /identity/v3/projects/54da9f11da824072acb54f348da7e461/groups/92d60313beb14ddba820e58797390054/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:01:46.565173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:46.621615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788b0c0-95b6-4507-a107-5f8f2dd6e1de None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:46.667262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888f02b-29ef-4b91-8148-d76136f3deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:46.668360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888f02b-29ef-4b91-8148-d76136f3deaa None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:46.668782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888f02b-29ef-4b91-8148-d76136f3deaa None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:46.669223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888f02b-29ef-4b91-8148-d76136f3deaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:46.684156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888f02b-29ef-4b91-8148-d76136f3deaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-2888f02b-29ef-4b91-8148-d76136f3deaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:46.692934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:46.694007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:46.694984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:46.697350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 195/397] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:46.704976 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521779d-8b25-46b5-a367-40afb24b54b8 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:46.850945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521779d-8b25-46b5-a367-40afb24b54b8 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:46.890049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d8e70-00e7-4abd-bc88-25475d21e29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:46.890981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d8e70-00e7-4abd-bc88-25475d21e29c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:46.891405 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d8e70-00e7-4abd-bc88-25475d21e29c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:46.891843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d8e70-00e7-4abd-bc88-25475d21e29c None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:46.892771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d8e70-00e7-4abd-bc88-25475d21e29c None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:46.893212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d8e70-00e7-4abd-bc88-25475d21e29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:46.894731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d8e70-00e7-4abd-bc88-25475d21e29c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:46.903465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 203/398] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:46.909854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888f02b-29ef-4b91-8148-d76136f3deaa None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:46.980154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b0b5e-cd8e-495b-bbe5-f6db3ccd1708 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:46.980442 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b0b5e-cd8e-495b-bbe5-f6db3ccd1708 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:46.980722 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b0b5e-cd8e-495b-bbe5-f6db3ccd1708 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:46.982907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 204/399] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:46.987994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418ccce-fee0-41a8-b866-208daf715f78 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:46.988281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418ccce-fee0-41a8-b866-208daf715f78 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:46.988558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418ccce-fee0-41a8-b866-208daf715f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:47.005444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-5418ccce-fee0-41a8-b866-208daf715f78 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:47.006617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5418ccce-fee0-41a8-b866-208daf715f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:47.046737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888f02b-29ef-4b91-8148-d76136f3deaa None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:47.076294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:47.081577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:47.087992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 205/400] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:47.103611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418ccce-fee0-41a8-b866-208daf715f78 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:47.123233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d7175-49c8-4da4-a999-589ddbe4aa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:47.124344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d7175-49c8-4da4-a999-589ddbe4aa4b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:47.124442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d7175-49c8-4da4-a999-589ddbe4aa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:47.124652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d7175-49c8-4da4-a999-589ddbe4aa4b None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:47.128575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d7175-49c8-4da4-a999-589ddbe4aa4b None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:47.130161 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d7175-49c8-4da4-a999-589ddbe4aa4b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:47.136280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 196/401] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:46 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:47.137150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d7175-49c8-4da4-a999-589ddbe4aa4b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:47.247978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418ccce-fee0-41a8-b866-208daf715f78 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:47.292017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1632dc-30bf-4c9b-a394-f8f387364bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:47.292957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1632dc-30bf-4c9b-a394-f8f387364bfb None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:47.293240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1632dc-30bf-4c9b-a394-f8f387364bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:47.293515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1632dc-30bf-4c9b-a394-f8f387364bfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:47.311064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1632dc-30bf-4c9b-a394-f8f387364bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-5c1632dc-30bf-4c9b-a394-f8f387364bfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:47.324510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:47.325427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:47.326758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 206/402] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:47.336174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1632dc-30bf-4c9b-a394-f8f387364bfb None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:47.343769 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d7175-49c8-4da4-a999-589ddbe4aa4b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:47.402670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3acf1-0506-45fb-b43c-9494f98e8764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:47.403540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3acf1-0506-45fb-b43c-9494f98e8764 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:47.403822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3acf1-0506-45fb-b43c-9494f98e8764 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:47.404168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3acf1-0506-45fb-b43c-9494f98e8764 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:47.406449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3acf1-0506-45fb-b43c-9494f98e8764 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:47.407911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3acf1-0506-45fb-b43c-9494f98e8764 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:47.409613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 197/403] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:47 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:47.415847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3acf1-0506-45fb-b43c-9494f98e8764 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:47.417475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:47.500479 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:47.505966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1632dc-30bf-4c9b-a394-f8f387364bfb None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:47.546633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261ca6e-bf24-49e4-897e-a5b9f064a7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:47.547300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ca6e-bf24-49e4-897e-a5b9f064a7fb None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:47.547583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ca6e-bf24-49e4-897e-a5b9f064a7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:47.549141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261ca6e-bf24-49e4-897e-a5b9f064a7fb None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:47.549903 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261ca6e-bf24-49e4-897e-a5b9f064a7fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:47.550210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261ca6e-bf24-49e4-897e-a5b9f064a7fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:47.551608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261ca6e-bf24-49e4-897e-a5b9f064a7fb None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:47.563266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3acf1-0506-45fb-b43c-9494f98e8764 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:47.564922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 207/404] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:47.566978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca65ea-b93d-434e-b16b-4b3cf5435522 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:47.566978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca65ea-b93d-434e-b16b-4b3cf5435522 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:47.566978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca65ea-b93d-434e-b16b-4b3cf5435522 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:47.569051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 208/405] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:47.569832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca65ea-b93d-434e-b16b-4b3cf5435522 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:47.610293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfff1fe-e8b5-4965-84bc-f4193ab51af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:47.611528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfff1fe-e8b5-4965-84bc-f4193ab51af9 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:47.612212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfff1fe-e8b5-4965-84bc-f4193ab51af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:47.612686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfff1fe-e8b5-4965-84bc-f4193ab51af9 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e/groups/92d60313beb14ddba820e58797390054/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:47.615380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfff1fe-e8b5-4965-84bc-f4193ab51af9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d287700518a644f8bd9772318b8e8e0e, group_id=92d60313beb14ddba820e58797390054, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:47.618203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfff1fe-e8b5-4965-84bc-f4193ab51af9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:47.670994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:47.678358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca65ea-b93d-434e-b16b-4b3cf5435522 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:47.711988 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f4cb4-50f5-4ea7-aa6b-e5db09feb157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:47.712843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f4cb4-50f5-4ea7-aa6b-e5db09feb157 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:47.713124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f4cb4-50f5-4ea7-aa6b-e5db09feb157 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:47.713398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f4cb4-50f5-4ea7-aa6b-e5db09feb157 None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:47.714561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f4cb4-50f5-4ea7-aa6b-e5db09feb157 None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:47.716020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f4cb4-50f5-4ea7-aa6b-e5db09feb157 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:47.722245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 209/406] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:47 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:47.722245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946f58-b89a-4ed0-8032-35eb322c8df7 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:47.722245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946f58-b89a-4ed0-8032-35eb322c8df7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:47.722245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946f58-b89a-4ed0-8032-35eb322c8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:47.732270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 198/407] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Jun 2 13:01:47 2022] PUT /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e/groups/92d60313beb14ddba820e58797390054/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:47.733589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfff1fe-e8b5-4965-84bc-f4193ab51af9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:47.747074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-73946f58-b89a-4ed0-8032-35eb322c8df7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:47.749170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-73946f58-b89a-4ed0-8032-35eb322c8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:47.862946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfff1fe-e8b5-4965-84bc-f4193ab51af9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:47.880761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:47.883474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 210/408] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:47.905374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac702390-d0d1-4d0f-be9b-ea5bcf639cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:47.906643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702390-d0d1-4d0f-be9b-ea5bcf639cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:47.907142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702390-d0d1-4d0f-be9b-ea5bcf639cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:47.907632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702390-d0d1-4d0f-be9b-ea5bcf639cc2 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:47.909210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac702390-d0d1-4d0f-be9b-ea5bcf639cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:47.910909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac702390-d0d1-4d0f-be9b-ea5bcf639cc2 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:47.913854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 199/409] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:47 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:47.919984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73946f58-b89a-4ed0-8032-35eb322c8df7 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:47.927780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac702390-d0d1-4d0f-be9b-ea5bcf639cc2 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:48.047683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:48.056580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73946f58-b89a-4ed0-8032-35eb322c8df7 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:48.103110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac702390-d0d1-4d0f-be9b-ea5bcf639cc2 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:48.103315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149cebf-2f09-40be-9d73-9855448e4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:48.104037 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149cebf-2f09-40be-9d73-9855448e4d45 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:48.104325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149cebf-2f09-40be-9d73-9855448e4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:48.104609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149cebf-2f09-40be-9d73-9855448e4d45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:48.129082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149cebf-2f09-40be-9d73-9855448e4d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-5149cebf-2f09-40be-9d73-9855448e4d45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:48.143506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:48.144678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:48.145619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 211/410] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:01:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:48.151013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149cebf-2f09-40be-9d73-9855448e4d45 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:48.155258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c3463-2ae2-46e8-968a-8e2fbc9514e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:48.156197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c3463-2ae2-46e8-968a-8e2fbc9514e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:48.156476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c3463-2ae2-46e8-968a-8e2fbc9514e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:48.156748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c3463-2ae2-46e8-968a-8e2fbc9514e0 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e/groups/92d60313beb14ddba820e58797390054/roles/c0027060d6364e5e9bd9c2cb5ad9788f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:48.159509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c3463-2ae2-46e8-968a-8e2fbc9514e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d287700518a644f8bd9772318b8e8e0e, group_id=92d60313beb14ddba820e58797390054, role_id=c0027060d6364e5e9bd9c2cb5ad9788f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:48.160994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c3463-2ae2-46e8-968a-8e2fbc9514e0 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:48.256316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 200/411] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Jun 2 13:01:47 2022] PUT /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e/groups/92d60313beb14ddba820e58797390054/roles/c0027060d6364e5e9bd9c2cb5ad9788f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:01:48.272484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149cebf-2f09-40be-9d73-9855448e4d45 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:48.312587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b02759-5b1f-4a47-bf42-b711bae09059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:48.313280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02759-5b1f-4a47-bf42-b711bae09059 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:48.313568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02759-5b1f-4a47-bf42-b711bae09059 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:48.313845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02759-5b1f-4a47-bf42-b711bae09059 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:48.314613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b02759-5b1f-4a47-bf42-b711bae09059 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:48.314925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b02759-5b1f-4a47-bf42-b711bae09059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:48.316355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b02759-5b1f-4a47-bf42-b711bae09059 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:48.326363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 212/412] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:48.332213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c3463-2ae2-46e8-968a-8e2fbc9514e0 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:48.411785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:48.485055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c3463-2ae2-46e8-968a-8e2fbc9514e0 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:48.520560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0640b-cf69-47a7-aac7-76084147d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:48.521788 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0640b-cf69-47a7-aac7-76084147d838 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:48.522284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0640b-cf69-47a7-aac7-76084147d838 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:48.522810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0640b-cf69-47a7-aac7-76084147d838 None admin] PATH_INFO: `/v3/groups/7a23c7a38a9049f5900feff6a719389c` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:48.524355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0640b-cf69-47a7-aac7-76084147d838 None admin] RBAC: Authorizing `identity:get_group(group_id=7a23c7a38a9049f5900feff6a719389c)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:48.526135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0640b-cf69-47a7-aac7-76084147d838 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:48.528439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 201/413] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:48 2022] GET /identity/v3/groups/7a23c7a38a9049f5900feff6a719389c => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:48.535925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b02759-5b1f-4a47-bf42-b711bae09059 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:48.563093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:48.750324 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9dbd1-9e1a-4d3f-9b38-d338653c87ab None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:48.750716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9dbd1-9e1a-4d3f-9b38-d338653c87ab None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:48.751069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9dbd1-9e1a-4d3f-9b38-d338653c87ab None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:48.752959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 202/414] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:48.758880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97436aa-4569-4233-b8f5-7a4d71352dca None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:48.759335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97436aa-4569-4233-b8f5-7a4d71352dca None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:48.759721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97436aa-4569-4233-b8f5-7a4d71352dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:48.782189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f97436aa-4569-4233-b8f5-7a4d71352dca None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:48.783466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f97436aa-4569-4233-b8f5-7a4d71352dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:48.807614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b02759-5b1f-4a47-bf42-b711bae09059 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:48.844297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d876a-217f-45cb-8508-e1a65388977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:48.845168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d876a-217f-45cb-8508-e1a65388977b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:48.845458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d876a-217f-45cb-8508-e1a65388977b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:48.845732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d876a-217f-45cb-8508-e1a65388977b None admin] PATH_INFO: `/v3/projects/4046aee9673645e2803f9186d9e29f17` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:48.846940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d876a-217f-45cb-8508-e1a65388977b None admin] RBAC: Authorizing `identity:get_project(project_id=4046aee9673645e2803f9186d9e29f17)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:48.848434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d876a-217f-45cb-8508-e1a65388977b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:48.850432 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 213/415] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:48 2022] GET /identity/v3/projects/4046aee9673645e2803f9186d9e29f17 => generated 344 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:48.856096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d876a-217f-45cb-8508-e1a65388977b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:48.868011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 203/416] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:48.905482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97436aa-4569-4233-b8f5-7a4d71352dca None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:48.960096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d876a-217f-45cb-8508-e1a65388977b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:48.962613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:48.996524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbca823-11a4-44a1-a14c-5b41874eba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:48.997474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbca823-11a4-44a1-a14c-5b41874eba26 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:48.997802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbca823-11a4-44a1-a14c-5b41874eba26 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:48.998089 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbca823-11a4-44a1-a14c-5b41874eba26 None admin] PATH_INFO: `/v3/projects/4046aee9673645e2803f9186d9e29f17/groups/7a23c7a38a9049f5900feff6a719389c/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:49.000203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbca823-11a4-44a1-a14c-5b41874eba26 None admin] RBAC: Authorizing `identity:create_grant(project_id=4046aee9673645e2803f9186d9e29f17, group_id=7a23c7a38a9049f5900feff6a719389c, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:49.001654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbca823-11a4-44a1-a14c-5b41874eba26 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:49.004959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:49.070136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97436aa-4569-4233-b8f5-7a4d71352dca None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:49.089460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 214/417] 10.222.0.46 () {58 vars in 1442 bytes} [Thu Jun 2 13:01:48 2022] PUT /identity/v3/projects/4046aee9673645e2803f9186d9e29f17/groups/7a23c7a38a9049f5900feff6a719389c/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:01:49.111482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e709c5-cd07-4a68-9c7d-2580f0c2ea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:49.112467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e709c5-cd07-4a68-9c7d-2580f0c2ea85 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:49.112994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e709c5-cd07-4a68-9c7d-2580f0c2ea85 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:49.113280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e709c5-cd07-4a68-9c7d-2580f0c2ea85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:49.127848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e709c5-cd07-4a68-9c7d-2580f0c2ea85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-72e709c5-cd07-4a68-9c7d-2580f0c2ea85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:49.137211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:49.138149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:49.140034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 204/418] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:49.145627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbca823-11a4-44a1-a14c-5b41874eba26 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:49.300572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbca823-11a4-44a1-a14c-5b41874eba26 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:49.345466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3832840-6790-4153-a202-8ee660713f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:49.346393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832840-6790-4153-a202-8ee660713f33 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:49.346825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832840-6790-4153-a202-8ee660713f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:49.347272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832840-6790-4153-a202-8ee660713f33 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:49.348310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3832840-6790-4153-a202-8ee660713f33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:49.348785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3832840-6790-4153-a202-8ee660713f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:49.350353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3832840-6790-4153-a202-8ee660713f33 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:49.361006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 215/419] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:49.367087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e709c5-cd07-4a68-9c7d-2580f0c2ea85 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:49.488155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:49.495644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e709c5-cd07-4a68-9c7d-2580f0c2ea85 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:49.541930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ddfdc-b9b0-4c04-bd22-fdbb39ee3cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:49.542593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ddfdc-b9b0-4c04-bd22-fdbb39ee3cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:49.542879 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ddfdc-b9b0-4c04-bd22-fdbb39ee3cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:49.543153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ddfdc-b9b0-4c04-bd22-fdbb39ee3cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:49.613447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ddfdc-b9b0-4c04-bd22-fdbb39ee3cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:49.614852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ddfdc-b9b0-4c04-bd22-fdbb39ee3cf5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:49.657305 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a360fd-b08f-4973-b57c-3599f7fd2c0e None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:49.657743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a360fd-b08f-4973-b57c-3599f7fd2c0e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:49.658133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a360fd-b08f-4973-b57c-3599f7fd2c0e None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:49.659840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 216/420] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:49.665293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb068a18-aae6-4683-94fd-922ea2940ad6 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:49.665694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb068a18-aae6-4683-94fd-922ea2940ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:49.666076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb068a18-aae6-4683-94fd-922ea2940ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:49.673799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:49.687089 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-bb068a18-aae6-4683-94fd-922ea2940ad6 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:49.688465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-bb068a18-aae6-4683-94fd-922ea2940ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:49.758555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:49.767305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 205/421] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:49.773456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 217/422] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:49.777190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ddfdc-b9b0-4c04-bd22-fdbb39ee3cf5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:49.801937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb068a18-aae6-4683-94fd-922ea2940ad6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:49.915651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ddfdc-b9b0-4c04-bd22-fdbb39ee3cf5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:49.963811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96e2af-b407-4d82-828a-5b3828d2c6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:49.966095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96e2af-b407-4d82-828a-5b3828d2c6ac None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:49.966377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96e2af-b407-4d82-828a-5b3828d2c6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:49.967186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96e2af-b407-4d82-828a-5b3828d2c6ac None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:49.970787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96e2af-b407-4d82-828a-5b3828d2c6ac None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:49.972350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96e2af-b407-4d82-828a-5b3828d2c6ac None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:49.974064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 206/423] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:49 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:49.981830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96e2af-b407-4d82-828a-5b3828d2c6ac None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:50.005537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb068a18-aae6-4683-94fd-922ea2940ad6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:50.074180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb948a-dfaa-457d-86ac-e4005b025a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:50.074998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb948a-dfaa-457d-86ac-e4005b025a09 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:50.075278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb948a-dfaa-457d-86ac-e4005b025a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:50.075547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb948a-dfaa-457d-86ac-e4005b025a09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:50.077680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:50.095966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb948a-dfaa-457d-86ac-e4005b025a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:50.108214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-2adb948a-dfaa-457d-86ac-e4005b025a09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:50.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:50.109533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:50.110310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:50.111522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 218/424] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:50.124727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb948a-dfaa-457d-86ac-e4005b025a09 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:50.178431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96e2af-b407-4d82-828a-5b3828d2c6ac None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:50.251081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ec6ab-b9f3-472e-818e-69e1081d7c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:50.251750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ec6ab-b9f3-472e-818e-69e1081d7c7c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:50.252061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ec6ab-b9f3-472e-818e-69e1081d7c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:50.252339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ec6ab-b9f3-472e-818e-69e1081d7c7c None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:50.253521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ec6ab-b9f3-472e-818e-69e1081d7c7c None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:50.255017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ec6ab-b9f3-472e-818e-69e1081d7c7c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:50.260791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 207/425] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:49 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:50.269745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ec6ab-b9f3-472e-818e-69e1081d7c7c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:50.272069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb948a-dfaa-457d-86ac-e4005b025a09 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:50.308178 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813f34-1b2d-4767-a96a-6859f1135456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:50.309234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813f34-1b2d-4767-a96a-6859f1135456 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:50.309727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813f34-1b2d-4767-a96a-6859f1135456 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:50.310354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813f34-1b2d-4767-a96a-6859f1135456 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:50.311298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d813f34-1b2d-4767-a96a-6859f1135456 None admin] RBAC: Adding query filter params (name=member) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:50.311798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d813f34-1b2d-4767-a96a-6859f1135456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:50.313676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d813f34-1b2d-4767-a96a-6859f1135456 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:50.323046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 219/426] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:50.331543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813f34-1b2d-4767-a96a-6859f1135456 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:50.434041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:50.456162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ec6ab-b9f3-472e-818e-69e1081d7c7c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:50.496987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e99661-868b-4e05-9e20-183545225ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:50.497673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e99661-868b-4e05-9e20-183545225ade None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:50.497965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e99661-868b-4e05-9e20-183545225ade None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:50.498246 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e99661-868b-4e05-9e20-183545225ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:50.499083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e99661-868b-4e05-9e20-183545225ade None admin] RBAC: Adding query filter params (group.id=92d60313beb14ddba820e58797390054, role.id=c0027060d6364e5e9bd9c2cb5ad9788f, scope.project.id=54da9f11da824072acb54f348da7e461) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:50.499398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e99661-868b-4e05-9e20-183545225ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:50.500898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e99661-868b-4e05-9e20-183545225ade None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:50.503335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:50.510934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 208/427] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Jun 2 13:01:50 2022] GET /identity/v3/role_assignments?group.id=92d60313beb14ddba820e58797390054&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=c0027060d6364e5e9bd9c2cb5ad9788f => generated 611 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:50.520756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813f34-1b2d-4767-a96a-6859f1135456 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:50.542193 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7048ab4-b2f7-454e-9895-c8bcc2c06d61 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:50.542813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7048ab4-b2f7-454e-9895-c8bcc2c06d61 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:50.543285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7048ab4-b2f7-454e-9895-c8bcc2c06d61 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:50.545255 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 209/428] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:01:50.553227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf380e74-0aeb-43f3-ae66-7954fc803e2b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:50.553555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf380e74-0aeb-43f3-ae66-7954fc803e2b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:50.554153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf380e74-0aeb-43f3-ae66-7954fc803e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:50.581766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-cf380e74-0aeb-43f3-ae66-7954fc803e2b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:50.585839 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cf380e74-0aeb-43f3-ae66-7954fc803e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:50.602167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5975125-a4c1-4e00-b555-e0f1b46a9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:50.603168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5975125-a4c1-4e00-b555-e0f1b46a9b08 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:50.603526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5975125-a4c1-4e00-b555-e0f1b46a9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:50.603955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5975125-a4c1-4e00-b555-e0f1b46a9b08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:50.716328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 210/429] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:50.738052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf380e74-0aeb-43f3-ae66-7954fc803e2b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:50.769147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5975125-a4c1-4e00-b555-e0f1b46a9b08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:50.770626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5975125-a4c1-4e00-b555-e0f1b46a9b08 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:50.845383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:50.883691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf380e74-0aeb-43f3-ae66-7954fc803e2b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:50.921053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 220/430] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:01:50.925293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:50.930703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5975125-a4c1-4e00-b555-e0f1b46a9b08 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:50.940765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5111f-2b16-4322-8af3-c22c4c9ce6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:50.941986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5111f-2b16-4322-8af3-c22c4c9ce6dd None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:50.942429 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5111f-2b16-4322-8af3-c22c4c9ce6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:50.942959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5111f-2b16-4322-8af3-c22c4c9ce6dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:50.956116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5111f-2b16-4322-8af3-c22c4c9ce6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-f4b5111f-2b16-4322-8af3-c22c4c9ce6dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:50.964982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:50.965862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:01:50.966737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:50.970182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 211/431] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:50.975664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5111f-2b16-4322-8af3-c22c4c9ce6dd None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:51.047770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5975125-a4c1-4e00-b555-e0f1b46a9b08 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:51.092076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb000ca1-ab56-4051-a5a3-9cf306181db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:51.093677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000ca1-ab56-4051-a5a3-9cf306181db2 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.094164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000ca1-ab56-4051-a5a3-9cf306181db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.094911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000ca1-ab56-4051-a5a3-9cf306181db2 None admin] PATH_INFO: `/v3/projects/54da9f11da824072acb54f348da7e461` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.097035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb000ca1-ab56-4051-a5a3-9cf306181db2 None admin] RBAC: Authorizing `identity:get_project(project_id=54da9f11da824072acb54f348da7e461)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:51.098777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb000ca1-ab56-4051-a5a3-9cf306181db2 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:51.099298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5111f-2b16-4322-8af3-c22c4c9ce6dd None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:51.101499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 221/432] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:50 2022] GET /identity/v3/projects/54da9f11da824072acb54f348da7e461 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:51.109751 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb000ca1-ab56-4051-a5a3-9cf306181db2 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:51.142692 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:51.145631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d6b4-a4d6-41d3-a854-24ae2969fd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:51.146809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d6b4-a4d6-41d3-a854-24ae2969fd4e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.147241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d6b4-a4d6-41d3-a854-24ae2969fd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.147664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d6b4-a4d6-41d3-a854-24ae2969fd4e None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.148773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6d6b4-a4d6-41d3-a854-24ae2969fd4e None admin] RBAC: Adding query filter params (name=member) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:51.155402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6d6b4-a4d6-41d3-a854-24ae2969fd4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:51.155402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6d6b4-a4d6-41d3-a854-24ae2969fd4e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:51.160205 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 212/433] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:01:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:51.165577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d6b4-a4d6-41d3-a854-24ae2969fd4e None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:51.227605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:51.235475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb000ca1-ab56-4051-a5a3-9cf306181db2 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:51.271258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b3afe-67cd-4c57-982a-9ab8dec42d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:51.272137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b3afe-67cd-4c57-982a-9ab8dec42d51 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.272420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b3afe-67cd-4c57-982a-9ab8dec42d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.272695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b3afe-67cd-4c57-982a-9ab8dec42d51 None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.273886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b3afe-67cd-4c57-982a-9ab8dec42d51 None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:51.275330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b3afe-67cd-4c57-982a-9ab8dec42d51 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:51.277048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 222/434] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:51 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:51.278244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e6483-8179-402c-99f7-2a763187e50d None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.278530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e6483-8179-402c-99f7-2a763187e50d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.278808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e6483-8179-402c-99f7-2a763187e50d None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.280399 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 223/435] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:51.282868 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e6483-8179-402c-99f7-2a763187e50d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:51.298022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d6b4-a4d6-41d3-a854-24ae2969fd4e None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:51.332701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a29a0-a1b2-47b1-aa14-5d3874a01883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:51.333356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a29a0-a1b2-47b1-aa14-5d3874a01883 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.333642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a29a0-a1b2-47b1-aa14-5d3874a01883 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.334351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a29a0-a1b2-47b1-aa14-5d3874a01883 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.390962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:51.400732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e6483-8179-402c-99f7-2a763187e50d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:51.416148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a29a0-a1b2-47b1-aa14-5d3874a01883 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:51.417627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a29a0-a1b2-47b1-aa14-5d3874a01883 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:51.435815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9ece6-d339-42eb-bd0b-4751cd1ada60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:51.436508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9ece6-d339-42eb-bd0b-4751cd1ada60 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.436789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9ece6-d339-42eb-bd0b-4751cd1ada60 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.437064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9ece6-d339-42eb-bd0b-4751cd1ada60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.437898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9ece6-d339-42eb-bd0b-4751cd1ada60 None admin] RBAC: Adding query filter params (group.id=92d60313beb14ddba820e58797390054, role.id=b35814b03f814680843c3aead86264f7, scope.project.id=54da9f11da824072acb54f348da7e461) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:51.438208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9ece6-d339-42eb-bd0b-4751cd1ada60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:51.439645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9ece6-d339-42eb-bd0b-4751cd1ada60 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:51.448229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 224/436] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Jun 2 13:01:51 2022] GET /identity/v3/role_assignments?group.id=92d60313beb14ddba820e58797390054&scope.project.id=54da9f11da824072acb54f348da7e461&role.id=b35814b03f814680843c3aead86264f7 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:51.450452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9c5f-8be1-4e30-8974-c8e93e940113 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.450941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9c5f-8be1-4e30-8974-c8e93e940113 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.451601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a9c5f-8be1-4e30-8974-c8e93e940113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.476394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-963a9c5f-8be1-4e30-8974-c8e93e940113 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:51.477389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:51.478355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-963a9c5f-8be1-4e30-8974-c8e93e940113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:51.553662 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 213/437] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:01:51.559192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a29a0-a1b2-47b1-aa14-5d3874a01883 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:51.580029 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 225/438] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:51.607547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a9c5f-8be1-4e30-8974-c8e93e940113 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:51.689030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a29a0-a1b2-47b1-aa14-5d3874a01883 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:51.701945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:51.722531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a9c5f-8be1-4e30-8974-c8e93e940113 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:51.734107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c8c1e-e430-4e1e-ace9-f2bd8d316f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:51.735180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c8c1e-e430-4e1e-ace9-f2bd8d316f46 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.735652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c8c1e-e430-4e1e-ace9-f2bd8d316f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.736013 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c8c1e-e430-4e1e-ace9-f2bd8d316f46 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.737303 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c8c1e-e430-4e1e-ace9-f2bd8d316f46 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:51.738775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c8c1e-e430-4e1e-ace9-f2bd8d316f46 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:51.740865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 214/439] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:51 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:51.748273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c8c1e-e430-4e1e-ace9-f2bd8d316f46 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:51.762767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e39913-7f5a-4ccc-9dba-ff6019ba7085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:51.763697 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39913-7f5a-4ccc-9dba-ff6019ba7085 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.764094 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39913-7f5a-4ccc-9dba-ff6019ba7085 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.764438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39913-7f5a-4ccc-9dba-ff6019ba7085 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.771941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:51.777309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e39913-7f5a-4ccc-9dba-ff6019ba7085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-11e39913-7f5a-4ccc-9dba-ff6019ba7085 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:51.785900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:51.786823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:51.788203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 226/440] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:51.793084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e39913-7f5a-4ccc-9dba-ff6019ba7085 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:51.883658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c8c1e-e430-4e1e-ace9-f2bd8d316f46 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:51.923722 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e39913-7f5a-4ccc-9dba-ff6019ba7085 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:51.924144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b9fc1-9534-411c-b5c7-e0651bb0fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:51.925013 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b9fc1-9534-411c-b5c7-e0651bb0fe88 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.925298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b9fc1-9534-411c-b5c7-e0651bb0fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.926105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b9fc1-9534-411c-b5c7-e0651bb0fe88 None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.927690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b9fc1-9534-411c-b5c7-e0651bb0fe88 None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:51.929170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b9fc1-9534-411c-b5c7-e0651bb0fe88 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:51.930801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 215/441] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:51 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:51.937186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02620b93-45aa-47f8-9afe-f550d92507d5 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.937566 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02620b93-45aa-47f8-9afe-f550d92507d5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.937837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02620b93-45aa-47f8-9afe-f550d92507d5 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.939147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 216/442] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:51.939972 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02620b93-45aa-47f8-9afe-f550d92507d5 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:51.972384 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d04d4-52dd-4dc7-a428-eaeefbb2ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:51.973333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d04d4-52dd-4dc7-a428-eaeefbb2ba2c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.973684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d04d4-52dd-4dc7-a428-eaeefbb2ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.973958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d04d4-52dd-4dc7-a428-eaeefbb2ba2c None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:51.974889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d04d4-52dd-4dc7-a428-eaeefbb2ba2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:51.975206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d04d4-52dd-4dc7-a428-eaeefbb2ba2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:51.976665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d04d4-52dd-4dc7-a428-eaeefbb2ba2c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:51.986117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 227/443] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:51.989403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c49b1-221d-49dc-9c4a-0c24ce206fdd None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:51.989698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c49b1-221d-49dc-9c4a-0c24ce206fdd None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:51.989982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c49b1-221d-49dc-9c4a-0c24ce206fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:52.009132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ec7c49b1-221d-49dc-9c4a-0c24ce206fdd None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:52.010328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ec7c49b1-221d-49dc-9c4a-0c24ce206fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:52.012408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:52.043951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:52.062296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02620b93-45aa-47f8-9afe-f550d92507d5 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:52.090516 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 228/444] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:52.091982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c49b1-221d-49dc-9c4a-0c24ce206fdd None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:52.099414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d4e82-ac95-4edd-9ac7-0ed46e71e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:52.100849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4e82-ac95-4edd-9ac7-0ed46e71e266 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:52.100849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4e82-ac95-4edd-9ac7-0ed46e71e266 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:52.101121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4e82-ac95-4edd-9ac7-0ed46e71e266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:52.101940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d4e82-ac95-4edd-9ac7-0ed46e71e266 None admin] RBAC: Adding query filter params (group.id=92d60313beb14ddba820e58797390054, role.id=b35814b03f814680843c3aead86264f7, scope.project.id=d287700518a644f8bd9772318b8e8e0e) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:52.104853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d4e82-ac95-4edd-9ac7-0ed46e71e266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:52.106338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d4e82-ac95-4edd-9ac7-0ed46e71e266 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:52.114748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 217/445] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Jun 2 13:01:51 2022] GET /identity/v3/role_assignments?group.id=92d60313beb14ddba820e58797390054&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=b35814b03f814680843c3aead86264f7 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:52.115864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d4e82-ac95-4edd-9ac7-0ed46e71e266 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:52.216928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c49b1-221d-49dc-9c4a-0c24ce206fdd None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:52.237038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d4e82-ac95-4edd-9ac7-0ed46e71e266 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:52.260650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a1c03-dad4-448b-b805-336243cea27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:52.261355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a1c03-dad4-448b-b805-336243cea27f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:52.261647 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a1c03-dad4-448b-b805-336243cea27f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:52.261923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a1c03-dad4-448b-b805-336243cea27f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:52.273667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:52.274012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22a5c4-bbaf-4ae4-bb1c-49411ff9f71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:52.274781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22a5c4-bbaf-4ae4-bb1c-49411ff9f71b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:52.275065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22a5c4-bbaf-4ae4-bb1c-49411ff9f71b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:52.275340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22a5c4-bbaf-4ae4-bb1c-49411ff9f71b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:52.288195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22a5c4-bbaf-4ae4-bb1c-49411ff9f71b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-fe22a5c4-bbaf-4ae4-bb1c-49411ff9f71b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:52.296895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:52.297854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:52.298633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 218/446] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:52.304318 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22a5c4-bbaf-4ae4-bb1c-49411ff9f71b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:52.317240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:52.342861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a1c03-dad4-448b-b805-336243cea27f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:52.344424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a1c03-dad4-448b-b805-336243cea27f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:52.433520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22a5c4-bbaf-4ae4-bb1c-49411ff9f71b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:52.472665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c1722-35f3-42bf-8499-75675cee2fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:52.473379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c1722-35f3-42bf-8499-75675cee2fdf None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:52.473747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c1722-35f3-42bf-8499-75675cee2fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:52.473939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c1722-35f3-42bf-8499-75675cee2fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:52.474695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c1722-35f3-42bf-8499-75675cee2fdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:52.475006 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c1722-35f3-42bf-8499-75675cee2fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:52.476409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 229/447] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:01:52.480270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c1722-35f3-42bf-8499-75675cee2fdf None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:52.481852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a1c03-dad4-448b-b805-336243cea27f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:52.489485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 219/448] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:52.495197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c1722-35f3-42bf-8499-75675cee2fdf None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:52.529637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:52.580020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:52.590305 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a1c03-dad4-448b-b805-336243cea27f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:52.608619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c1722-35f3-42bf-8499-75675cee2fdf None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:52.624158 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd8ec-0033-43f8-8468-56a591e11d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:52.625025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd8ec-0033-43f8-8468-56a591e11d35 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:52.625307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd8ec-0033-43f8-8468-56a591e11d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:52.625581 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd8ec-0033-43f8-8468-56a591e11d35 None admin] PATH_INFO: `/v3/projects/d287700518a644f8bd9772318b8e8e0e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:52.626761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bd8ec-0033-43f8-8468-56a591e11d35 None admin] RBAC: Authorizing `identity:get_project(project_id=d287700518a644f8bd9772318b8e8e0e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:52.628228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bd8ec-0033-43f8-8468-56a591e11d35 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:52.629916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 230/449] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:52 2022] GET /identity/v3/projects/d287700518a644f8bd9772318b8e8e0e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:52.635292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd8ec-0033-43f8-8468-56a591e11d35 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:52.641566 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476100d4-1e9a-44b0-ac22-122912e1dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:52.642227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476100d4-1e9a-44b0-ac22-122912e1dffd None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:52.642513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476100d4-1e9a-44b0-ac22-122912e1dffd None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:52.642795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476100d4-1e9a-44b0-ac22-122912e1dffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:52.713505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476100d4-1e9a-44b0-ac22-122912e1dffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:52.714962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476100d4-1e9a-44b0-ac22-122912e1dffd None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:52.739105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd8ec-0033-43f8-8468-56a591e11d35 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:52.746657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:52.772671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4b63e-11b0-4b17-a953-8b2b20852a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:52.773530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b63e-11b0-4b17-a953-8b2b20852a74 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:52.773816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b63e-11b0-4b17-a953-8b2b20852a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:52.774090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b63e-11b0-4b17-a953-8b2b20852a74 None admin] PATH_INFO: `/v3/groups/92d60313beb14ddba820e58797390054` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:52.775277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4b63e-11b0-4b17-a953-8b2b20852a74 None admin] RBAC: Authorizing `identity:get_group(group_id=92d60313beb14ddba820e58797390054)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:52.776744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4b63e-11b0-4b17-a953-8b2b20852a74 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:52.778377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 231/450] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:52 2022] GET /identity/v3/groups/92d60313beb14ddba820e58797390054 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:52.784564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4b63e-11b0-4b17-a953-8b2b20852a74 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:52.786209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:52.816758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 220/451] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:01:52.823231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476100d4-1e9a-44b0-ac22-122912e1dffd None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:52.885851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4b63e-11b0-4b17-a953-8b2b20852a74 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:52.920848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633afd52-74a8-4ed5-8487-8c1bb7926f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:52.921473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476100d4-1e9a-44b0-ac22-122912e1dffd None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:52.921606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633afd52-74a8-4ed5-8487-8c1bb7926f15 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:52.921837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633afd52-74a8-4ed5-8487-8c1bb7926f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:52.922137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633afd52-74a8-4ed5-8487-8c1bb7926f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:52.923129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633afd52-74a8-4ed5-8487-8c1bb7926f15 None admin] RBAC: Adding query filter params (group.id=92d60313beb14ddba820e58797390054, role.id=c0027060d6364e5e9bd9c2cb5ad9788f, scope.project.id=d287700518a644f8bd9772318b8e8e0e) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:52.923447 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633afd52-74a8-4ed5-8487-8c1bb7926f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:52.924932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633afd52-74a8-4ed5-8487-8c1bb7926f15 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:52.931105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 232/452] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Jun 2 13:01:52 2022] GET /identity/v3/role_assignments?group.id=92d60313beb14ddba820e58797390054&scope.project.id=d287700518a644f8bd9772318b8e8e0e&role.id=c0027060d6364e5e9bd9c2cb5ad9788f => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:52.957770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbf1f-a141-4106-8fd6-cc65d92d7d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:52.958682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbf1f-a141-4106-8fd6-cc65d92d7d84 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:52.958963 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbf1f-a141-4106-8fd6-cc65d92d7d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:52.959237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bbf1f-a141-4106-8fd6-cc65d92d7d84 None admin] PATH_INFO: `/v3/projects/4046aee9673645e2803f9186d9e29f17` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:52.960526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bbf1f-a141-4106-8fd6-cc65d92d7d84 None admin] RBAC: Authorizing `identity:get_project(project_id=4046aee9673645e2803f9186d9e29f17)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:52.962027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bbf1f-a141-4106-8fd6-cc65d92d7d84 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:52.963805 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 221/453] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:01:52 2022] GET /identity/v3/projects/4046aee9673645e2803f9186d9e29f17 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:52.969571 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633afd52-74a8-4ed5-8487-8c1bb7926f15 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:53.013804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:53.078090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633afd52-74a8-4ed5-8487-8c1bb7926f15 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:53.114642 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05002ff7-4948-4e2a-aa36-bac3d47a766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:53.115613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05002ff7-4948-4e2a-aa36-bac3d47a766d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:53.115955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05002ff7-4948-4e2a-aa36-bac3d47a766d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:53.116246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05002ff7-4948-4e2a-aa36-bac3d47a766d None admin] PATH_INFO: `/v3/groups/7a23c7a38a9049f5900feff6a719389c` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:53.117788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05002ff7-4948-4e2a-aa36-bac3d47a766d None admin] RBAC: Authorizing `identity:get_group(group_id=7a23c7a38a9049f5900feff6a719389c)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:53.119525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05002ff7-4948-4e2a-aa36-bac3d47a766d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:53.121219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 233/454] 10.222.0.46 () {56 vars in 1180 bytes} [Thu Jun 2 13:01:52 2022] GET /identity/v3/groups/7a23c7a38a9049f5900feff6a719389c => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:53.127528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbf1f-a141-4106-8fd6-cc65d92d7d84 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:53.170362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:53.232905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bbf1f-a141-4106-8fd6-cc65d92d7d84 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:53.267671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04aa895-8f0f-4086-9df8-d042439cadc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:53.268334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa895-8f0f-4086-9df8-d042439cadc4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:53.268562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa895-8f0f-4086-9df8-d042439cadc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:53.268846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04aa895-8f0f-4086-9df8-d042439cadc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:53.269674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa895-8f0f-4086-9df8-d042439cadc4 None admin] RBAC: Adding query filter params (group.id=7a23c7a38a9049f5900feff6a719389c, role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=4046aee9673645e2803f9186d9e29f17) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:53.269987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa895-8f0f-4086-9df8-d042439cadc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:53.271423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04aa895-8f0f-4086-9df8-d042439cadc4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:53.277481 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 222/455] 10.222.0.46 () {56 vars in 1376 bytes} [Thu Jun 2 13:01:53 2022] GET /identity/v3/role_assignments?group.id=7a23c7a38a9049f5900feff6a719389c&scope.project.id=4046aee9673645e2803f9186d9e29f17&role.id=31c5600d1f984a04827cf0052fc61678 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:56.012119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614281-343c-415a-8831-b95c7f9b3890 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.012660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614281-343c-415a-8831-b95c7f9b3890 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.012660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614281-343c-415a-8831-b95c7f9b3890 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.014823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 234/456] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:56.020223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc959-7ba5-4616-bcfb-a336a7b83d71 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.020638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc959-7ba5-4616-bcfb-a336a7b83d71 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.020822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc959-7ba5-4616-bcfb-a336a7b83d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.042661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d65bc959-7ba5-4616-bcfb-a336a7b83d71 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:56.043840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d65bc959-7ba5-4616-bcfb-a336a7b83d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:56.148680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 223/457] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:56.183715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a614281-343c-415a-8831-b95c7f9b3890 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:56.275194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317600e-74e6-4f2e-89c3-4a96b9cb1c19 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.275500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317600e-74e6-4f2e-89c3-4a96b9cb1c19 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.275686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317600e-74e6-4f2e-89c3-4a96b9cb1c19 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.277058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 224/458] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:01:56.282403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ec9a-cd54-47a0-8f6c-d26ff160b62a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.282976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ec9a-cd54-47a0-8f6c-d26ff160b62a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.283431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ec9a-cd54-47a0-8f6c-d26ff160b62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.311520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-6e77ec9a-cd54-47a0-8f6c-d26ff160b62a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:56.312731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6e77ec9a-cd54-47a0-8f6c-d26ff160b62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:56.341339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a614281-343c-415a-8831-b95c7f9b3890 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:56.350509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:56.355046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:56.387734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5826e-b6d6-4220-b592-36e19d33a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:56.389098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5826e-b6d6-4220-b592-36e19d33a911 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.389563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5826e-b6d6-4220-b592-36e19d33a911 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.390003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5826e-b6d6-4220-b592-36e19d33a911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.402726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 225/459] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:56.404158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a23270-8633-4c0d-9029-86b829b5014e None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.404448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a23270-8633-4c0d-9029-86b829b5014e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.404725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a23270-8633-4c0d-9029-86b829b5014e None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.409889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 226/460] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:56.410162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5826e-b6d6-4220-b592-36e19d33a911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:56.411661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5826e-b6d6-4220-b592-36e19d33a911 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:56.412157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0180e-3575-40e2-9d47-a46711d84921 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.412641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0180e-3575-40e2-9d47-a46711d84921 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.413123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0180e-3575-40e2-9d47-a46711d84921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-adb5826e-b6d6-4220-b592-36e19d33a911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:01:56.431731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:56.432682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:56.434138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:01:56.434138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:01:56.434138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:01:56.434138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:56.434138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 235/461] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:56.434686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9ab0180e-3575-40e2-9d47-a46711d84921 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:56.436663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9ab0180e-3575-40e2-9d47-a46711d84921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:56.441818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5826e-b6d6-4220-b592-36e19d33a911 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:56.520046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 227/462] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:56.521472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0180e-3575-40e2-9d47-a46711d84921 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:56.563295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5826e-b6d6-4220-b592-36e19d33a911 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:56.600431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3e7ca-41eb-43de-8ece-81d2447ce5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:56.601109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3e7ca-41eb-43de-8ece-81d2447ce5ea None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.601387 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3e7ca-41eb-43de-8ece-81d2447ce5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.601661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3e7ca-41eb-43de-8ece-81d2447ce5ea None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.602388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3e7ca-41eb-43de-8ece-81d2447ce5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:56.602717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3e7ca-41eb-43de-8ece-81d2447ce5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:56.604218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3e7ca-41eb-43de-8ece-81d2447ce5ea None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:56.618052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 236/463] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:56.619001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3e7ca-41eb-43de-8ece-81d2447ce5ea None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:56.639192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:56.651213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:56.659113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0180e-3575-40e2-9d47-a46711d84921 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:56.695620 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486d0a2-646f-4f45-9a81-b1bab691fef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:56.696854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486d0a2-646f-4f45-9a81-b1bab691fef1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.697335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486d0a2-646f-4f45-9a81-b1bab691fef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.697822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486d0a2-646f-4f45-9a81-b1bab691fef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.709873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486d0a2-646f-4f45-9a81-b1bab691fef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:56.711736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486d0a2-646f-4f45-9a81-b1bab691fef1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:56.725406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3e7ca-41eb-43de-8ece-81d2447ce5ea None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-d486d0a2-646f-4f45-9a81-b1bab691fef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:01:56.732872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:56.733745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:56.735043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:01:56.735043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:01:56.735043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:01:56.735043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:56.736798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 228/464] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:56.737930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486d0a2-646f-4f45-9a81-b1bab691fef1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:56.767842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea8d9a-660d-45fb-b269-1036c73a3a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:56.768772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8d9a-660d-45fb-b269-1036c73a3a71 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.769059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8d9a-660d-45fb-b269-1036c73a3a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.769331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8d9a-660d-45fb-b269-1036c73a3a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.781315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea8d9a-660d-45fb-b269-1036c73a3a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:56.782783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea8d9a-660d-45fb-b269-1036c73a3a71 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-5eea8d9a-660d-45fb-b269-1036c73a3a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:01:56.801412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:56.802331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:56.803783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:01:56.803783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:01:56.803783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:01:56.803783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:56.803783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 237/465] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:56.803783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea8d9a-660d-45fb-b269-1036c73a3a71 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:56.851138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486d0a2-646f-4f45-9a81-b1bab691fef1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:56.884534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:56.888357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6bed1-3c66-4d21-9f4d-c9865e1e9093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:56.889105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6bed1-3c66-4d21-9f4d-c9865e1e9093 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.889460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6bed1-3c66-4d21-9f4d-c9865e1e9093 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.889804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6bed1-3c66-4d21-9f4d-c9865e1e9093 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.890574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6bed1-3c66-4d21-9f4d-c9865e1e9093 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:56.892142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6bed1-3c66-4d21-9f4d-c9865e1e9093 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:56.910238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea8d9a-660d-45fb-b269-1036c73a3a71 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:56.944949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9a3c5-7297-4b63-bc8d-ff076baf9536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:56.945616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9a3c5-7297-4b63-bc8d-ff076baf9536 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:56.945901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9a3c5-7297-4b63-bc8d-ff076baf9536 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:56.946177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9a3c5-7297-4b63-bc8d-ff076baf9536 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:56.946933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9a3c5-7297-4b63-bc8d-ff076baf9536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:56.947237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9a3c5-7297-4b63-bc8d-ff076baf9536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:56.948644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9a3c5-7297-4b63-bc8d-ff076baf9536 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:56.961270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 238/466] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:56.962095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9a3c5-7297-4b63-bc8d-ff076baf9536 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:57.029837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 229/467] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:01:56 2022] POST /identity/v3/users => generated 246 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:57.041718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a82e23-d6d1-4453-b632-f5efa6658b50 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:57.042050 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a82e23-d6d1-4453-b632-f5efa6658b50 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:57.042286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a82e23-d6d1-4453-b632-f5efa6658b50 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:57.043664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 230/468] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:57 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:57.044429 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a82e23-d6d1-4453-b632-f5efa6658b50 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:57.050722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:57.085279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9a3c5-7297-4b63-bc8d-ff076baf9536 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:57.123383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:57.129997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b8577-31ba-4f1e-8c32-c52d67e67388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:57.130681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b8577-31ba-4f1e-8c32-c52d67e67388 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:57.130959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b8577-31ba-4f1e-8c32-c52d67e67388 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:57.131233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b8577-31ba-4f1e-8c32-c52d67e67388 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:57.132021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b8577-31ba-4f1e-8c32-c52d67e67388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:57.132330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b8577-31ba-4f1e-8c32-c52d67e67388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:57.133743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b8577-31ba-4f1e-8c32-c52d67e67388 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:57.152443 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 239/469] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:01:57.154843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dbb5f-7fe2-40fd-8600-67f3c3a65494 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:57.155361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dbb5f-7fe2-40fd-8600-67f3c3a65494 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:57.155831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dbb5f-7fe2-40fd-8600-67f3c3a65494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:57.175008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-304dbb5f-7fe2-40fd-8600-67f3c3a65494 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:57.176828 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-304dbb5f-7fe2-40fd-8600-67f3c3a65494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:57.205302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a82e23-d6d1-4453-b632-f5efa6658b50 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:57.243339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171ae4-ffae-4c6d-b422-34942d82b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:57.243949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171ae4-ffae-4c6d-b422-34942d82b8b7 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:57.244234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171ae4-ffae-4c6d-b422-34942d82b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:57.244509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171ae4-ffae-4c6d-b422-34942d82b8b7 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:57.245220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171ae4-ffae-4c6d-b422-34942d82b8b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:57.246687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171ae4-ffae-4c6d-b422-34942d82b8b7 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:57.266339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 240/470] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:57.267185 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dbb5f-7fe2-40fd-8600-67f3c3a65494 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:57.374427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dbb5f-7fe2-40fd-8600-67f3c3a65494 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:57.390046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 231/471] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:01:57 2022] POST /identity/v3/users => generated 248 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:57.391192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171ae4-ffae-4c6d-b422-34942d82b8b7 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:57.402956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:57.423497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36115734-ed4a-42d9-8cab-ee20c80dfab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:57.427102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115734-ed4a-42d9-8cab-ee20c80dfab5 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:57.427806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115734-ed4a-42d9-8cab-ee20c80dfab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:57.428361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115734-ed4a-42d9-8cab-ee20c80dfab5 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:57.429275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36115734-ed4a-42d9-8cab-ee20c80dfab5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:57.430996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36115734-ed4a-42d9-8cab-ee20c80dfab5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:57.481939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:57.527757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171ae4-ffae-4c6d-b422-34942d82b8b7 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:57.543598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 241/472] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:01:57 2022] POST /identity/v3/users => generated 248 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:57.545823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26370-b979-479a-9c9c-a95b2c7134df None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:57.546357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26370-b979-479a-9c9c-a95b2c7134df None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:57.546917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26370-b979-479a-9c9c-a95b2c7134df None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:57.548983 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 242/473] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:57.564809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f35e8-f031-4481-ae42-21c28df10cf3 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:57.565439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f35e8-f031-4481-ae42-21c28df10cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:57.565934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f35e8-f031-4481-ae42-21c28df10cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:57.599818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-460f35e8-f031-4481-ae42-21c28df10cf3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:57.602522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-460f35e8-f031-4481-ae42-21c28df10cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:57.610908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a9f7e-5604-49be-b07e-d48f41dac6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:57.611740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a9f7e-5604-49be-b07e-d48f41dac6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:57.612212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a9f7e-5604-49be-b07e-d48f41dac6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:57.612491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a9f7e-5604-49be-b07e-d48f41dac6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:57.627326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a9f7e-5604-49be-b07e-d48f41dac6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:57.628740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a9f7e-5604-49be-b07e-d48f41dac6e0 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-439a9f7e-5604-49be-b07e-d48f41dac6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:01:57.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:57.650131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:57.651177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:01:57.651177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:01:57.651177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:01:57.651177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:01:57.651177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 232/474] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:57.656570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a9f7e-5604-49be-b07e-d48f41dac6e0 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:57.795911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 243/475] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:01:57.822260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f35e8-f031-4481-ae42-21c28df10cf3 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:57.824972 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a9f7e-5604-49be-b07e-d48f41dac6e0 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:57.836211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:57.864650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cafce-35b0-441f-82b9-16b8aea9576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:57.865330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cafce-35b0-441f-82b9-16b8aea9576a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:57.865611 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cafce-35b0-441f-82b9-16b8aea9576a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:57.865967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cafce-35b0-441f-82b9-16b8aea9576a None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:57.867067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cafce-35b0-441f-82b9-16b8aea9576a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:57.867374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cafce-35b0-441f-82b9-16b8aea9576a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:57.868968 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cafce-35b0-441f-82b9-16b8aea9576a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:57.890082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 233/476] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:57.895365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cafce-35b0-441f-82b9-16b8aea9576a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:57.948803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f35e8-f031-4481-ae42-21c28df10cf3 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:57.957930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:57.993392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ce2da-030d-40fd-b6a3-8edfaab5886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:57.994558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ce2da-030d-40fd-b6a3-8edfaab5886d None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:57.995051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ce2da-030d-40fd-b6a3-8edfaab5886d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:57.995677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ce2da-030d-40fd-b6a3-8edfaab5886d None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:57.996929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ce2da-030d-40fd-b6a3-8edfaab5886d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:57.999836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ce2da-030d-40fd-b6a3-8edfaab5886d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:58.021185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cafce-35b0-441f-82b9-16b8aea9576a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:58.033850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.sql.core [None req-f26ce2da-030d-40fd-b6a3-8edfaab5886d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:01:58.033850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 13:01:58.033850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [parameters: {'id': 'fe5164ec2b944f4a9e1d57102dd442d3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 13:01:58.033850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80584) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-f26ce2da-030d-40fd-b6a3-8edfaab5886d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application result.read() Jun 02 13:01:58.068355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:01:58.069345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application yield resource Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise self.value Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application session.commit() Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:01:58.070244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:01:58.071057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:01:58.071914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application result.read() Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:01:58.072724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [parameters: {'id': 'fe5164ec2b944f4a9e1d57102dd442d3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:58.073489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 13:01:58.074252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:58.077591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 244/477] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Jun 2 13:01:57 2022] POST /identity/v3/roles => generated 144 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:01:58.077591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ce2da-030d-40fd-b6a3-8edfaab5886d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:58.083354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cb692-4fc9-409e-8dfa-3e82020300aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:58.084668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cb692-4fc9-409e-8dfa-3e82020300aa None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:58.085091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cb692-4fc9-409e-8dfa-3e82020300aa None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:58.085567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cb692-4fc9-409e-8dfa-3e82020300aa None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:58.086412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cb692-4fc9-409e-8dfa-3e82020300aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:58.090335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cb692-4fc9-409e-8dfa-3e82020300aa None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:58.189162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 234/478] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:01:57 2022] POST /identity/v3/users => generated 249 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:01:58.230194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ce2da-030d-40fd-b6a3-8edfaab5886d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:58.270453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96e006-ca66-4cff-a128-6e3de3271ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:58.271658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96e006-ca66-4cff-a128-6e3de3271ecf None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:58.272106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96e006-ca66-4cff-a128-6e3de3271ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:58.272522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96e006-ca66-4cff-a128-6e3de3271ecf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:58.285019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96e006-ca66-4cff-a128-6e3de3271ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-db96e006-ca66-4cff-a128-6e3de3271ecf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:01:58.293669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:01:58.295345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:01:58.296331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:01:58.303362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 245/479] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:01:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:01:58.305168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cb692-4fc9-409e-8dfa-3e82020300aa None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:58.348878 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:01:58.452404 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cb692-4fc9-409e-8dfa-3e82020300aa None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:01:58.488390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b35b66-22f2-407b-84ec-88f158f9e5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:01:58.489347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b35b66-22f2-407b-84ec-88f158f9e5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:58.492275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b35b66-22f2-407b-84ec-88f158f9e5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:58.492708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b35b66-22f2-407b-84ec-88f158f9e5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:58.493696 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b35b66-22f2-407b-84ec-88f158f9e5a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:01:58.494142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b35b66-22f2-407b-84ec-88f158f9e5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:01:58.495666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b35b66-22f2-407b-84ec-88f158f9e5a6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:01:58.512142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 235/480] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:01:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:01:59.782137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192b371-71d3-4d39-8073-da4a166a5f93 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:59.782635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192b371-71d3-4d39-8073-da4a166a5f93 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:59.782635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192b371-71d3-4d39-8073-da4a166a5f93 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:59.784241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 246/481] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:59.789726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d09c-72e8-4aad-a92a-0b5cfda27d39 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:59.790521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d09c-72e8-4aad-a92a-0b5cfda27d39 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:59.791014 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d09c-72e8-4aad-a92a-0b5cfda27d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:59.813209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b4e8d09c-72e8-4aad-a92a-0b5cfda27d39 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:59.814738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b4e8d09c-72e8-4aad-a92a-0b5cfda27d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:59.891926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 236/482] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:01:59.931144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192b371-71d3-4d39-8073-da4a166a5f93 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:01:59.948183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859d92-f0f8-4d0a-b002-68b7abb3295f None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:59.948783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859d92-f0f8-4d0a-b002-68b7abb3295f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:59.949264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859d92-f0f8-4d0a-b002-68b7abb3295f None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:59.951641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 237/483] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:01:59.958923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d127a-fbf5-4c80-9374-122ca8f70ba8 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:01:59.960042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d127a-fbf5-4c80-9374-122ca8f70ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:01:59.960661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d127a-fbf5-4c80-9374-122ca8f70ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:01:59.980408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0c0d127a-fbf5-4c80-9374-122ca8f70ba8 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:01:59.983113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0c0d127a-fbf5-4c80-9374-122ca8f70ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:01:59.985106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:00.024298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:00.072462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 238/484] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:02:00.094771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d127a-fbf5-4c80-9374-122ca8f70ba8 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:00.147770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192b371-71d3-4d39-8073-da4a166a5f93 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:00.217927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53123-155d-453b-a5af-0dab6c7471f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:00.220110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53123-155d-453b-a5af-0dab6c7471f5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:00.222070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53123-155d-453b-a5af-0dab6c7471f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:00.222557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf53123-155d-453b-a5af-0dab6c7471f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:00.245229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf53123-155d-453b-a5af-0dab6c7471f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-fbf53123-155d-453b-a5af-0dab6c7471f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:00.258366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:00.259330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:00.260115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:00.267842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 247/485] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:01:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:00.270226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53123-155d-453b-a5af-0dab6c7471f5 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:00.290043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d127a-fbf5-4c80-9374-122ca8f70ba8 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:00.351979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e0268-e14a-48a4-b5bc-2574f5deb265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:00.353127 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e0268-e14a-48a4-b5bc-2574f5deb265 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:00.353648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e0268-e14a-48a4-b5bc-2574f5deb265 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:00.354115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e0268-e14a-48a4-b5bc-2574f5deb265 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:00.365715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e0268-e14a-48a4-b5bc-2574f5deb265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-f28e0268-e14a-48a4-b5bc-2574f5deb265 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:00.374438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:00.375315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:00.376122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:00.383342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 239/486] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:00.384843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e0268-e14a-48a4-b5bc-2574f5deb265 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:00.405416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:00.460874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:00.467955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf53123-155d-453b-a5af-0dab6c7471f5 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:00.519337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca3cb-a7fc-493a-a27e-a2fe48b778f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:00.520308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca3cb-a7fc-493a-a27e-a2fe48b778f0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:00.520601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca3cb-a7fc-493a-a27e-a2fe48b778f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:00.520881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca3cb-a7fc-493a-a27e-a2fe48b778f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:00.521894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca3cb-a7fc-493a-a27e-a2fe48b778f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:00.522792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca3cb-a7fc-493a-a27e-a2fe48b778f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:00.524659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca3cb-a7fc-493a-a27e-a2fe48b778f0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:00.531908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e0268-e14a-48a4-b5bc-2574f5deb265 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:00.538998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 248/487] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:00.541220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032b467-470b-4125-85eb-e53ac51c4d0a None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:00.541605 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032b467-470b-4125-85eb-e53ac51c4d0a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:00.542397 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032b467-470b-4125-85eb-e53ac51c4d0a None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:00.547966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 249/488] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:00.548885 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032b467-470b-4125-85eb-e53ac51c4d0a None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:00.579174 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbce810-cda5-47fe-8af9-802a0de60a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:00.580032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbce810-cda5-47fe-8af9-802a0de60a4a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:00.580422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbce810-cda5-47fe-8af9-802a0de60a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:00.580805 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbce810-cda5-47fe-8af9-802a0de60a4a None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:00.581708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbce810-cda5-47fe-8af9-802a0de60a4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:00.582122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbce810-cda5-47fe-8af9-802a0de60a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:00.583629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbce810-cda5-47fe-8af9-802a0de60a4a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:00.594452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 240/489] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:00.595945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe7a69-6e86-4e96-8754-9626d78b2007 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:00.596340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe7a69-6e86-4e96-8754-9626d78b2007 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:00.596722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe7a69-6e86-4e96-8754-9626d78b2007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:00.614889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-aebe7a69-6e86-4e96-8754-9626d78b2007 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:00.616545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-aebe7a69-6e86-4e96-8754-9626d78b2007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:00.676146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032b467-470b-4125-85eb-e53ac51c4d0a None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:00.696549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:00.709474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 241/490] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:00.709474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe7a69-6e86-4e96-8754-9626d78b2007 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:00.726430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96653b0-9be4-46c0-a7ba-c1c93f22812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:00.727569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96653b0-9be4-46c0-a7ba-c1c93f22812e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:00.728157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96653b0-9be4-46c0-a7ba-c1c93f22812e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:00.728623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96653b0-9be4-46c0-a7ba-c1c93f22812e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:00.742615 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96653b0-9be4-46c0-a7ba-c1c93f22812e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:00.745012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96653b0-9be4-46c0-a7ba-c1c93f22812e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-c96653b0-9be4-46c0-a7ba-c1c93f22812e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:00.770674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:00.771563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:00.772424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:00.772424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:00.772424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:00.772424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:00.773858 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 250/491] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:00.774575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96653b0-9be4-46c0-a7ba-c1c93f22812e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:00.781350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:00.841458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe7a69-6e86-4e96-8754-9626d78b2007 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:00.891451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aa37c-76f6-4c73-8077-42246f2b5dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:00.892921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aa37c-76f6-4c73-8077-42246f2b5dbe None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:00.893669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aa37c-76f6-4c73-8077-42246f2b5dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:00.894567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aa37c-76f6-4c73-8077-42246f2b5dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:00.903388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96653b0-9be4-46c0-a7ba-c1c93f22812e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:00.910207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0aa37c-76f6-4c73-8077-42246f2b5dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:00.912786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0aa37c-76f6-4c73-8077-42246f2b5dbe None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-9c0aa37c-76f6-4c73-8077-42246f2b5dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:00.940312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:00.941234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:00.942062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:00.942062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:00.942062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:00.942062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:00.942062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 242/492] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:00.942759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aa37c-76f6-4c73-8077-42246f2b5dbe None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:00.950054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6098e-2399-4fa7-aa07-649761b3efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:00.951650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6098e-2399-4fa7-aa07-649761b3efb3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:00.952833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6098e-2399-4fa7-aa07-649761b3efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:00.953369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6098e-2399-4fa7-aa07-649761b3efb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:00.969517 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6098e-2399-4fa7-aa07-649761b3efb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-72b6098e-2399-4fa7-aa07-649761b3efb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:00.980767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:00.982278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:00.983140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:00.986731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 251/493] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:00.988190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6098e-2399-4fa7-aa07-649761b3efb3 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.010384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:01.060975 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aa37c-76f6-4c73-8077-42246f2b5dbe None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:01.064005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:01.098005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666f863-d76c-43a9-8281-081e7f2fedd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:01.098846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f863-d76c-43a9-8281-081e7f2fedd2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.099285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f863-d76c-43a9-8281-081e7f2fedd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.099732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f863-d76c-43a9-8281-081e7f2fedd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.100583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666f863-d76c-43a9-8281-081e7f2fedd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:01.101001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666f863-d76c-43a9-8281-081e7f2fedd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:01.102515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666f863-d76c-43a9-8281-081e7f2fedd2 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:01.106033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6098e-2399-4fa7-aa07-649761b3efb3 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:01.115865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 243/494] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:01.117209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666f863-d76c-43a9-8281-081e7f2fedd2 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.143122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf718f-bf9e-4b65-8745-2493a52b0d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:01.144033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf718f-bf9e-4b65-8745-2493a52b0d1b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.144460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf718f-bf9e-4b65-8745-2493a52b0d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.144864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf718f-bf9e-4b65-8745-2493a52b0d1b None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.145742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf718f-bf9e-4b65-8745-2493a52b0d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:01.146186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf718f-bf9e-4b65-8745-2493a52b0d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:01.147688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf718f-bf9e-4b65-8745-2493a52b0d1b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:01.161088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 252/495] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:01.162225 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf718f-bf9e-4b65-8745-2493a52b0d1b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.227325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666f863-d76c-43a9-8281-081e7f2fedd2 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:01.241963 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:01.265084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef315fb-9621-4c29-9a55-6e9b9d8b3948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:01.265793 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef315fb-9621-4c29-9a55-6e9b9d8b3948 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.266304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef315fb-9621-4c29-9a55-6e9b9d8b3948 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.266304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef315fb-9621-4c29-9a55-6e9b9d8b3948 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.267086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef315fb-9621-4c29-9a55-6e9b9d8b3948 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:01.267399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef315fb-9621-4c29-9a55-6e9b9d8b3948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:01.269000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef315fb-9621-4c29-9a55-6e9b9d8b3948 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:01.269947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf718f-bf9e-4b65-8745-2493a52b0d1b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:01.278864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 244/496] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:01.280108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef315fb-9621-4c29-9a55-6e9b9d8b3948 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.295793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:01.306760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e40d8d-6767-4bfa-8f4c-a53a5a73198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:01.307732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e40d8d-6767-4bfa-8f4c-a53a5a73198e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.308068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e40d8d-6767-4bfa-8f4c-a53a5a73198e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.326934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e40d8d-6767-4bfa-8f4c-a53a5a73198e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.326934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e40d8d-6767-4bfa-8f4c-a53a5a73198e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:01.326934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e40d8d-6767-4bfa-8f4c-a53a5a73198e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-50e40d8d-6767-4bfa-8f4c-a53a5a73198e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:01.333044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:01.334240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 253/497] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Jun 2 13:02:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:01.335631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc822-0fc8-479a-a7fb-8754e7fcd310 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.336433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc822-0fc8-479a-a7fb-8754e7fcd310 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.336433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dc822-0fc8-479a-a7fb-8754e7fcd310 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.337532 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 254/498] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:01.338069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dc822-0fc8-479a-a7fb-8754e7fcd310 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.389694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef315fb-9621-4c29-9a55-6e9b9d8b3948 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:01.424490 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad904e-e045-4f7c-a01d-0f568db67e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:01.425288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad904e-e045-4f7c-a01d-0f568db67e05 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.425575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad904e-e045-4f7c-a01d-0f568db67e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.425858 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad904e-e045-4f7c-a01d-0f568db67e05 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.433320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad904e-e045-4f7c-a01d-0f568db67e05 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:01.434790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad904e-e045-4f7c-a01d-0f568db67e05 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:01.446998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dc822-0fc8-479a-a7fb-8754e7fcd310 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-bbad904e-e045-4f7c-a01d-0f568db67e05 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:01.449948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:01.470593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 245/499] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cef6c-ee57-4328-a2ec-b384665d6681 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.471492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cef6c-ee57-4328-a2ec-b384665d6681 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.472596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cef6c-ee57-4328-a2ec-b384665d6681 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.472596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 246/500] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:01.472596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cef6c-ee57-4328-a2ec-b384665d6681 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.485446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa336e-458a-45b0-b72e-7c7bb22c74e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:01.486248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa336e-458a-45b0-b72e-7c7bb22c74e9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.486529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa336e-458a-45b0-b72e-7c7bb22c74e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.486799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa336e-458a-45b0-b72e-7c7bb22c74e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.494149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:01.497781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa336e-458a-45b0-b72e-7c7bb22c74e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:01.499248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa336e-458a-45b0-b72e-7c7bb22c74e9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-b6aa336e-458a-45b0-b72e-7c7bb22c74e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:01.517545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:01.518484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:01.519363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:01.519363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:01.519363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:01.519363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:01.519363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 255/501] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:01.520057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32026027-4c70-41f7-84cf-6053a08c894b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.529179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32026027-4c70-41f7-84cf-6053a08c894b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.529179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32026027-4c70-41f7-84cf-6053a08c894b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.537765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-32026027-4c70-41f7-84cf-6053a08c894b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:01.538979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-32026027-4c70-41f7-84cf-6053a08c894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:01.566384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cef6c-ee57-4328-a2ec-b384665d6681 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:01.566801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:01.600309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a346f55-163a-4b81-b364-a77bb280f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:01.600976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a346f55-163a-4b81-b364-a77bb280f9cf None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.601257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a346f55-163a-4b81-b364-a77bb280f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.601547 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a346f55-163a-4b81-b364-a77bb280f9cf None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.602363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a346f55-163a-4b81-b364-a77bb280f9cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:01.602670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a346f55-163a-4b81-b364-a77bb280f9cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:01.604149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a346f55-163a-4b81-b364-a77bb280f9cf None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:01.609890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 256/502] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:01.610652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32026027-4c70-41f7-84cf-6053a08c894b None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.645287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 247/503] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Jun 2 13:02:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:01.645287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779a92-5875-408b-b414-5e1a0de7419e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.645287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779a92-5875-408b-b414-5e1a0de7419e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.645287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779a92-5875-408b-b414-5e1a0de7419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.658928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f2779a92-5875-408b-b414-5e1a0de7419e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:01.660075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f2779a92-5875-408b-b414-5e1a0de7419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:01.718385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32026027-4c70-41f7-84cf-6053a08c894b None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:01.724849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 248/504] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:01.725671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779a92-5875-408b-b414-5e1a0de7419e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.749383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:01.766511 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b981f78-f186-474b-849a-01d13814cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:01.767185 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b981f78-f186-474b-849a-01d13814cd2f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.767466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b981f78-f186-474b-849a-01d13814cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.767738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b981f78-f186-474b-849a-01d13814cd2f None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.768606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b981f78-f186-474b-849a-01d13814cd2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:01.768913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b981f78-f186-474b-849a-01d13814cd2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:01.770402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b981f78-f186-474b-849a-01d13814cd2f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:01.806244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 257/505] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Jun 2 13:02:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:01.807111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b981f78-f186-474b-849a-01d13814cd2f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.829944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779a92-5875-408b-b414-5e1a0de7419e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:01.832170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:01.863196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da0c6b-0360-4369-8d40-34ec169d1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:01.863858 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da0c6b-0360-4369-8d40-34ec169d1e85 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.864166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da0c6b-0360-4369-8d40-34ec169d1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.864441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da0c6b-0360-4369-8d40-34ec169d1e85 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.865153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da0c6b-0360-4369-8d40-34ec169d1e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:01.865458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da0c6b-0360-4369-8d40-34ec169d1e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:01.867140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da0c6b-0360-4369-8d40-34ec169d1e85 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:01.879113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 249/506] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:01.883639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da0c6b-0360-4369-8d40-34ec169d1e85 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.904871 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b981f78-f186-474b-849a-01d13814cd2f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:01.937844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad96b10-78f0-4dfe-873c-09d3afce6633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:01.938562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad96b10-78f0-4dfe-873c-09d3afce6633 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:01.938844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad96b10-78f0-4dfe-873c-09d3afce6633 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:01.939117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad96b10-78f0-4dfe-873c-09d3afce6633 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:01.949008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad96b10-78f0-4dfe-873c-09d3afce6633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-8ad96b10-78f0-4dfe-873c-09d3afce6633 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:01.957248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:01.958138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:01.958914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 258/507] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:01.959560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad96b10-78f0-4dfe-873c-09d3afce6633 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:01.964612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:01.982538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da0c6b-0360-4369-8d40-34ec169d1e85 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:02.018179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374df6e-fc7e-4873-971c-703d2954219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:02.018870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374df6e-fc7e-4873-971c-703d2954219a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:02.019154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374df6e-fc7e-4873-971c-703d2954219a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:02.019431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374df6e-fc7e-4873-971c-703d2954219a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:02.043012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:02.057866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad96b10-78f0-4dfe-873c-09d3afce6633 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:02.085546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374df6e-fc7e-4873-971c-703d2954219a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:02.087064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374df6e-fc7e-4873-971c-703d2954219a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:02.092139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa610f-32bf-417b-a4f6-4025a3c3fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:02.092936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa610f-32bf-417b-a4f6-4025a3c3fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:02.093217 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa610f-32bf-417b-a4f6-4025a3c3fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:02.093488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa610f-32bf-417b-a4f6-4025a3c3fcb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:02.103993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa610f-32bf-417b-a4f6-4025a3c3fcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:02.105450 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa610f-32bf-417b-a4f6-4025a3c3fcb6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-d2aa610f-32bf-417b-a4f6-4025a3c3fcb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:02.123251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:02.124174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:02.125025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:02.125025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:02.125025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:02.125025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:02.128167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 259/508] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:02.129156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa610f-32bf-417b-a4f6-4025a3c3fcb6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:02.167759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:02.186859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 250/509] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:02.187707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374df6e-fc7e-4873-971c-703d2954219a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:02.229011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa610f-32bf-417b-a4f6-4025a3c3fcb6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:02.265879 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0c098-ba5f-417a-be9b-63429377d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:02.266547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0c098-ba5f-417a-be9b-63429377d769 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:02.266869 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0c098-ba5f-417a-be9b-63429377d769 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:02.267143 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0c098-ba5f-417a-be9b-63429377d769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:02.271152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:02.338190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0c098-ba5f-417a-be9b-63429377d769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:02.339684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0c098-ba5f-417a-be9b-63429377d769 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:02.407446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374df6e-fc7e-4873-971c-703d2954219a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:02.440401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 260/510] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:02.441005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad635-f66e-49e2-890a-b999ef97c533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:02.441519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0c098-ba5f-417a-be9b-63429377d769 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:02.441796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad635-f66e-49e2-890a-b999ef97c533 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:02.442074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad635-f66e-49e2-890a-b999ef97c533 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:02.442345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad635-f66e-49e2-890a-b999ef97c533 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:02.449927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ad635-f66e-49e2-890a-b999ef97c533 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:02.451416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ad635-f66e-49e2-890a-b999ef97c533 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-ad7ad635-f66e-49e2-890a-b999ef97c533 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:02.465641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:02.466700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:02.467570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 251/511] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:02.468158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad635-f66e-49e2-890a-b999ef97c533 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:02.480571 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:02.511269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:02.544731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0c098-ba5f-417a-be9b-63429377d769 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:02.566423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad635-f66e-49e2-890a-b999ef97c533 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:02.579386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68555fca-671c-4a97-b5f1-ff41956c5c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:02.580122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555fca-671c-4a97-b5f1-ff41956c5c62 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:02.580403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555fca-671c-4a97-b5f1-ff41956c5c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:02.580680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555fca-671c-4a97-b5f1-ff41956c5c62 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:02.581434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68555fca-671c-4a97-b5f1-ff41956c5c62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:02.581748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68555fca-671c-4a97-b5f1-ff41956c5c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:02.583137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68555fca-671c-4a97-b5f1-ff41956c5c62 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:02.591584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 261/512] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:02.592425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68555fca-671c-4a97-b5f1-ff41956c5c62 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:02.602798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ac30-4f61-43df-88cd-87514249a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:02.603468 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ac30-4f61-43df-88cd-87514249a2fb None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:02.603759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ac30-4f61-43df-88cd-87514249a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:02.604073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ac30-4f61-43df-88cd-87514249a2fb None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:02.604795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370ac30-4f61-43df-88cd-87514249a2fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:02.605096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370ac30-4f61-43df-88cd-87514249a2fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:02.607085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370ac30-4f61-43df-88cd-87514249a2fb None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:02.619205 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 252/513] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:02.620051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ac30-4f61-43df-88cd-87514249a2fb None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:02.689451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:02.694180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68555fca-671c-4a97-b5f1-ff41956c5c62 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:02.715493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ac30-4f61-43df-88cd-87514249a2fb None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:02.717715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:02.727777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644be70-a7e9-4b32-b14d-df1ccc0048bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:02.728610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644be70-a7e9-4b32-b14d-df1ccc0048bb None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:02.728898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644be70-a7e9-4b32-b14d-df1ccc0048bb None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:02.729178 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644be70-a7e9-4b32-b14d-df1ccc0048bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:02.742798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644be70-a7e9-4b32-b14d-df1ccc0048bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:02.742798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644be70-a7e9-4b32-b14d-df1ccc0048bb None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:02.749802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d36163-a80e-4368-b180-79573ee44ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:02.750589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d36163-a80e-4368-b180-79573ee44ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:02.750872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d36163-a80e-4368-b180-79573ee44ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:02.751151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d36163-a80e-4368-b180-79573ee44ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:02.760773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d36163-a80e-4368-b180-79573ee44ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-2644be70-a7e9-4b32-b14d-df1ccc0048bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:02.761535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:02.762404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:02.763623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:02.763623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:02.763623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:02.763623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:02.764122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d36163-a80e-4368-b180-79573ee44ee2 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:02.764213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 262/514] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:02.764213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644be70-a7e9-4b32-b14d-df1ccc0048bb None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-47d36163-a80e-4368-b180-79573ee44ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:02.781771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:02.782630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:02.783527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:02.783527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:02.783527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:02.783527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:02.783527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 253/515] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:02.783784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d36163-a80e-4368-b180-79573ee44ee2 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:02.861816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644be70-a7e9-4b32-b14d-df1ccc0048bb None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:02.880051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d36163-a80e-4368-b180-79573ee44ee2 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:02.894893 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490827dc-9257-42de-9d43-76632fdaa6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:02.895558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490827dc-9257-42de-9d43-76632fdaa6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:02.895838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490827dc-9257-42de-9d43-76632fdaa6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:02.896146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490827dc-9257-42de-9d43-76632fdaa6f2 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:02.896974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490827dc-9257-42de-9d43-76632fdaa6f2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:02.897277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490827dc-9257-42de-9d43-76632fdaa6f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:02.899037 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490827dc-9257-42de-9d43-76632fdaa6f2 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:02.912634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8603-7f79-4651-9582-1797c627446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:02.913416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8603-7f79-4651-9582-1797c627446a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:02.913704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8603-7f79-4651-9582-1797c627446a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:02.913976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f8603-7f79-4651-9582-1797c627446a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:02.916265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 263/516] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Jun 2 13:02:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:02.916874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490827dc-9257-42de-9d43-76632fdaa6f2 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:02.925817 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f8603-7f79-4651-9582-1797c627446a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:02.927265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f8603-7f79-4651-9582-1797c627446a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:02.928628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-0e2f8603-7f79-4651-9582-1797c627446a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:02.944268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:02.945143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:02.945967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:02.945967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:02.945967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:02.945967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:02.945967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 254/517] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:02.946236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8603-7f79-4651-9582-1797c627446a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:02.960785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:03.024014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490827dc-9257-42de-9d43-76632fdaa6f2 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:03.051133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f8603-7f79-4651-9582-1797c627446a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:03.058236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934953d6-c3d3-447d-a4d2-c441bba30703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:03.058925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934953d6-c3d3-447d-a4d2-c441bba30703 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:03.059211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934953d6-c3d3-447d-a4d2-c441bba30703 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:03.059516 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934953d6-c3d3-447d-a4d2-c441bba30703 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:03.060265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934953d6-c3d3-447d-a4d2-c441bba30703 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:03.061701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934953d6-c3d3-447d-a4d2-c441bba30703 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:03.084080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0563f-4eba-4b50-932a-169d4d8a8608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:03.084750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0563f-4eba-4b50-932a-169d4d8a8608 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:03.085028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0563f-4eba-4b50-932a-169d4d8a8608 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:03.085300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0563f-4eba-4b50-932a-169d4d8a8608 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:03.086003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0563f-4eba-4b50-932a-169d4d8a8608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:03.086303 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0563f-4eba-4b50-932a-169d4d8a8608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:03.087639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0563f-4eba-4b50-932a-169d4d8a8608 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:03.099686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 255/518] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:03.100515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0563f-4eba-4b50-932a-169d4d8a8608 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:03.163846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:03.165155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 264/519] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:02:02 2022] POST /identity/v3/users => generated 247 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:02:03.170674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934953d6-c3d3-447d-a4d2-c441bba30703 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:03.204703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0563f-4eba-4b50-932a-169d4d8a8608 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:03.243299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:03.248933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865f260-67d1-4e28-9922-0f9205716f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:03.249902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865f260-67d1-4e28-9922-0f9205716f34 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:03.250190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865f260-67d1-4e28-9922-0f9205716f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:03.250466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865f260-67d1-4e28-9922-0f9205716f34 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:03.251441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865f260-67d1-4e28-9922-0f9205716f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:03.251930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865f260-67d1-4e28-9922-0f9205716f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:03.255805 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865f260-67d1-4e28-9922-0f9205716f34 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:03.272792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 256/520] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:03.273806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865f260-67d1-4e28-9922-0f9205716f34 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:03.292263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934953d6-c3d3-447d-a4d2-c441bba30703 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:03.336441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2bfd6-0f30-48a3-8283-f855246b7196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:03.337399 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2bfd6-0f30-48a3-8283-f855246b7196 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:03.337842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2bfd6-0f30-48a3-8283-f855246b7196 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:03.338118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2bfd6-0f30-48a3-8283-f855246b7196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:03.388701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865f260-67d1-4e28-9922-0f9205716f34 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:03.419787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:03.420717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2bfd6-0f30-48a3-8283-f855246b7196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:03.422190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2bfd6-0f30-48a3-8283-f855246b7196 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:03.429610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83178319-8f30-40fb-a246-967265add52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:03.430471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83178319-8f30-40fb-a246-967265add52a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:03.433678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83178319-8f30-40fb-a246-967265add52a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:03.433678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83178319-8f30-40fb-a246-967265add52a None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:03.433678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83178319-8f30-40fb-a246-967265add52a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:03.433678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83178319-8f30-40fb-a246-967265add52a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:03.434213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83178319-8f30-40fb-a246-967265add52a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:03.447270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 257/521] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:03.448218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83178319-8f30-40fb-a246-967265add52a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:03.491698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:03.532989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 265/522] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:03.533857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2bfd6-0f30-48a3-8283-f855246b7196 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:03.561946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83178319-8f30-40fb-a246-967265add52a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:03.602210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11081169-fa3d-44e6-9d91-887ff6fe1e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:03.602990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11081169-fa3d-44e6-9d91-887ff6fe1e9e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:03.603275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11081169-fa3d-44e6-9d91-887ff6fe1e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:03.603551 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11081169-fa3d-44e6-9d91-887ff6fe1e9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:03.610496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11081169-fa3d-44e6-9d91-887ff6fe1e9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:03.611980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11081169-fa3d-44e6-9d91-887ff6fe1e9e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-11081169-fa3d-44e6-9d91-887ff6fe1e9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:03.630352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:03.631350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:03.632326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:03.632326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:03.632326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:03.632326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:03.632326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:03.632326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:03.632326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:03.632326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:03.634087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 258/523] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:03.635185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11081169-fa3d-44e6-9d91-887ff6fe1e9e None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:03.645470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2bfd6-0f30-48a3-8283-f855246b7196 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:03.680940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5548-831a-44ed-b070-b20df2d151b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:03.681747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5548-831a-44ed-b070-b20df2d151b4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:03.682028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5548-831a-44ed-b070-b20df2d151b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:03.682304 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e5548-831a-44ed-b070-b20df2d151b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:03.688226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:03.689599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e5548-831a-44ed-b070-b20df2d151b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:03.691167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e5548-831a-44ed-b070-b20df2d151b4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-164e5548-831a-44ed-b070-b20df2d151b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:03.706461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:03.707365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:03.708706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:03.708706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:03.708706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:03.708706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:03.708706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:03.708706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:03.708706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:03.708706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:03.712237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 266/524] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:03.713313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5548-831a-44ed-b070-b20df2d151b4 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:03.744502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:03.749243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11081169-fa3d-44e6-9d91-887ff6fe1e9e None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:03.785163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962a1f-3db4-4c10-af2c-7a144bdef3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:03.785961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962a1f-3db4-4c10-af2c-7a144bdef3cb None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:03.786244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962a1f-3db4-4c10-af2c-7a144bdef3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:03.786514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962a1f-3db4-4c10-af2c-7a144bdef3cb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:03.795582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962a1f-3db4-4c10-af2c-7a144bdef3cb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:03.797062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962a1f-3db4-4c10-af2c-7a144bdef3cb None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-1b962a1f-3db4-4c10-af2c-7a144bdef3cb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:03.811901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:03.813153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 259/525] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:03.814314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962a1f-3db4-4c10-af2c-7a144bdef3cb None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:03.826640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e5548-831a-44ed-b070-b20df2d151b4 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:03.862535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943d56e-a3de-41af-b521-e67d43808331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:03.863498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d56e-a3de-41af-b521-e67d43808331 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:03.863785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d56e-a3de-41af-b521-e67d43808331 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:03.864092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943d56e-a3de-41af-b521-e67d43808331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:03.876610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943d56e-a3de-41af-b521-e67d43808331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:03.878241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943d56e-a3de-41af-b521-e67d43808331 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-e943d56e-a3de-41af-b521-e67d43808331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:03.895320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:03.896265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:03.897098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:03.897098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:03.897098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:03.897098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:03.897098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 267/526] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:03.897410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943d56e-a3de-41af-b521-e67d43808331 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:03.927815 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962a1f-3db4-4c10-af2c-7a144bdef3cb None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:03.936492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:03.962635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18759075-3b23-451b-ab9c-ed9ffc7e14c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:03.963301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18759075-3b23-451b-ab9c-ed9ffc7e14c3 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:03.963586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18759075-3b23-451b-ab9c-ed9ffc7e14c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:03.963867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18759075-3b23-451b-ab9c-ed9ffc7e14c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:03.964686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18759075-3b23-451b-ab9c-ed9ffc7e14c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:03.964995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18759075-3b23-451b-ab9c-ed9ffc7e14c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:03.966451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18759075-3b23-451b-ab9c-ed9ffc7e14c3 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:03.979085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:03.985913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 260/527] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:03.991494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18759075-3b23-451b-ab9c-ed9ffc7e14c3 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:04.004730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943d56e-a3de-41af-b521-e67d43808331 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:04.042076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038de41-6217-4ee8-b038-a57bf0dbebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:04.042753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038de41-6217-4ee8-b038-a57bf0dbebc3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:04.043042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038de41-6217-4ee8-b038-a57bf0dbebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:04.043324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038de41-6217-4ee8-b038-a57bf0dbebc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:04.044695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038de41-6217-4ee8-b038-a57bf0dbebc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:04.045009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038de41-6217-4ee8-b038-a57bf0dbebc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:04.046457 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038de41-6217-4ee8-b038-a57bf0dbebc3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:04.064658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 268/528] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:04.065417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038de41-6217-4ee8-b038-a57bf0dbebc3 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:04.102156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18759075-3b23-451b-ab9c-ed9ffc7e14c3 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:04.138524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113242-29ef-4531-9e13-4ef37bd2e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:04.139199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113242-29ef-4531-9e13-4ef37bd2e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:04.139485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113242-29ef-4531-9e13-4ef37bd2e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:04.139764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113242-29ef-4531-9e13-4ef37bd2e4b4 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:04.140669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91113242-29ef-4531-9e13-4ef37bd2e4b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:04.140936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91113242-29ef-4531-9e13-4ef37bd2e4b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:04.142367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91113242-29ef-4531-9e13-4ef37bd2e4b4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:04.164814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 261/529] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Jun 2 13:02:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:04.164814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113242-29ef-4531-9e13-4ef37bd2e4b4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:04.179608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038de41-6217-4ee8-b038-a57bf0dbebc3 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:04.189509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:04.215464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9914b-5c8f-499c-8921-32431b09dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:04.217192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9914b-5c8f-499c-8921-32431b09dd14 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:04.217192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9914b-5c8f-499c-8921-32431b09dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:04.217546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9914b-5c8f-499c-8921-32431b09dd14 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:04.218366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9914b-5c8f-499c-8921-32431b09dd14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:04.218794 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9914b-5c8f-499c-8921-32431b09dd14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:04.220320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9914b-5c8f-499c-8921-32431b09dd14 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:04.223404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:04.233420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 269/530] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:04.238358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9914b-5c8f-499c-8921-32431b09dd14 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:04.266406 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113242-29ef-4531-9e13-4ef37bd2e4b4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:04.307518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91c997-b7c0-4047-81fd-8b1415d4c7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:04.308211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c997-b7c0-4047-81fd-8b1415d4c7ea None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:04.308500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c997-b7c0-4047-81fd-8b1415d4c7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:04.308779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c997-b7c0-4047-81fd-8b1415d4c7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:04.309754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91c997-b7c0-4047-81fd-8b1415d4c7ea None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=ae1c6084061f4434864e9f7bcc553733) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:04.310068 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91c997-b7c0-4047-81fd-8b1415d4c7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:04.312041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91c997-b7c0-4047-81fd-8b1415d4c7ea None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:04.318249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 262/531] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:04 2022] GET /identity/v3/role_assignments?user.id=ae1c6084061f4434864e9f7bcc553733&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:04.319044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91c997-b7c0-4047-81fd-8b1415d4c7ea None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:04.358557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9914b-5c8f-499c-8921-32431b09dd14 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:04.417942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ba43e-dc6d-4e9d-a365-52050a21ba09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:04.420263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ba43e-dc6d-4e9d-a365-52050a21ba09 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:04.420712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ba43e-dc6d-4e9d-a365-52050a21ba09 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:04.421163 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ba43e-dc6d-4e9d-a365-52050a21ba09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:04.422475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ba43e-dc6d-4e9d-a365-52050a21ba09 None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=979519f42f7d463bb2ee1d5b0bb72a45) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:04.423513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ba43e-dc6d-4e9d-a365-52050a21ba09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:04.425553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ba43e-dc6d-4e9d-a365-52050a21ba09 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:04.430810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:04.436385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 270/532] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:04 2022] GET /identity/v3/role_assignments?user.id=979519f42f7d463bb2ee1d5b0bb72a45&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:04.437648 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ba43e-dc6d-4e9d-a365-52050a21ba09 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:04.466640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91c997-b7c0-4047-81fd-8b1415d4c7ea None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:04.544524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:04.565790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ba43e-dc6d-4e9d-a365-52050a21ba09 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:04.589424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30885a-fc91-4001-a4fc-07b3945d1d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:04.590111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30885a-fc91-4001-a4fc-07b3945d1d74 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:04.590400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30885a-fc91-4001-a4fc-07b3945d1d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:04.591477 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30885a-fc91-4001-a4fc-07b3945d1d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:04.617872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b6ff7-a818-4063-8843-ce2960f6c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:04.618763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b6ff7-a818-4063-8843-ce2960f6c69a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:04.619056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b6ff7-a818-4063-8843-ce2960f6c69a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:04.619335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b6ff7-a818-4063-8843-ce2960f6c69a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:04.627340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b6ff7-a818-4063-8843-ce2960f6c69a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:04.638451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b6ff7-a818-4063-8843-ce2960f6c69a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-f41b6ff7-a818-4063-8843-ce2960f6c69a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:04.646346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:04.647221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:04.648719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:04.648719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:04.648719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:04.648719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:04.648719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:04.648719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:04.648719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:04.648719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:04.648719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 271/533] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:04.654297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b6ff7-a818-4063-8843-ce2960f6c69a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:04.762413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30885a-fc91-4001-a4fc-07b3945d1d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:04.764467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30885a-fc91-4001-a4fc-07b3945d1d74 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:04.788757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b6ff7-a818-4063-8843-ce2960f6c69a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:04.812804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:04.837073 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4368f4-4e5c-4873-a825-f4e2c5d94c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:04.838270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4368f4-4e5c-4873-a825-f4e2c5d94c18 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:04.838800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4368f4-4e5c-4873-a825-f4e2c5d94c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:04.839270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4368f4-4e5c-4873-a825-f4e2c5d94c18 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:04.840336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4368f4-4e5c-4873-a825-f4e2c5d94c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:04.841144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4368f4-4e5c-4873-a825-f4e2c5d94c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:04.843709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4368f4-4e5c-4873-a825-f4e2c5d94c18 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:04.862051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 272/534] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:04.870532 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4368f4-4e5c-4873-a825-f4e2c5d94c18 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:04.916254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:04.933512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 263/535] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:04.938702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30885a-fc91-4001-a4fc-07b3945d1d74 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:05.062767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4368f4-4e5c-4873-a825-f4e2c5d94c18 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:05.123036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30885a-fc91-4001-a4fc-07b3945d1d74 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:05.127284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad6b27-23aa-46a5-b086-90dcb313905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:05.128166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad6b27-23aa-46a5-b086-90dcb313905a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:05.128606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad6b27-23aa-46a5-b086-90dcb313905a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:05.129019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad6b27-23aa-46a5-b086-90dcb313905a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:05.129992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad6b27-23aa-46a5-b086-90dcb313905a None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=c2bc11c0ef524d7ea5cb8704fbbfcbb2) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:05.130443 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad6b27-23aa-46a5-b086-90dcb313905a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:05.132042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad6b27-23aa-46a5-b086-90dcb313905a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:05.146860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 273/536] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:04 2022] GET /identity/v3/role_assignments?user.id=c2bc11c0ef524d7ea5cb8704fbbfcbb2&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:05.187677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a80280-5dc3-46cd-88ee-4c98f081ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:05.188796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a80280-5dc3-46cd-88ee-4c98f081ea58 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:05.189224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a80280-5dc3-46cd-88ee-4c98f081ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:05.189654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a80280-5dc3-46cd-88ee-4c98f081ea58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:05.208426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a80280-5dc3-46cd-88ee-4c98f081ea58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:05.209926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a80280-5dc3-46cd-88ee-4c98f081ea58 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-f8a80280-5dc3-46cd-88ee-4c98f081ea58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:05.240453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:05.241631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:05.242444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:05.242444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:05.242444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:05.242444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:05.247595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad6b27-23aa-46a5-b086-90dcb313905a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:05.248235 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 264/537] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:05.320141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:05.378351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad6b27-23aa-46a5-b086-90dcb313905a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:05.416498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679cf2-57ab-4a95-9478-3d4469a7c3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:05.417532 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679cf2-57ab-4a95-9478-3d4469a7c3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:05.418051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679cf2-57ab-4a95-9478-3d4469a7c3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:05.418522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679cf2-57ab-4a95-9478-3d4469a7c3e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:05.419472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679cf2-57ab-4a95-9478-3d4469a7c3e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:05.420070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679cf2-57ab-4a95-9478-3d4469a7c3e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:05.421668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679cf2-57ab-4a95-9478-3d4469a7c3e0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:05.435357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 274/538] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:05.440562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a80280-5dc3-46cd-88ee-4c98f081ea58 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:05.505059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:05.566731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a80280-5dc3-46cd-88ee-4c98f081ea58 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:05.609498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5007e-449a-418a-bcdb-11dc54546eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:05.610304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5007e-449a-418a-bcdb-11dc54546eaf None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:05.610590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5007e-449a-418a-bcdb-11dc54546eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:05.610868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5007e-449a-418a-bcdb-11dc54546eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:05.616835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a0bee-1094-4386-8ba7-82c51c40179c None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:05.617126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a0bee-1094-4386-8ba7-82c51c40179c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:05.617415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a0bee-1094-4386-8ba7-82c51c40179c None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:05.618497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5007e-449a-418a-bcdb-11dc54546eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:05.618998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 275/539] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:05.620216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5007e-449a-418a-bcdb-11dc54546eaf None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:05.625112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b05fa-4ff6-49a1-902f-879010817442 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:05.625399 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b05fa-4ff6-49a1-902f-879010817442 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:05.625679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b05fa-4ff6-49a1-902f-879010817442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-f7f5007e-449a-418a-bcdb-11dc54546eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:05.635213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:05.636090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:05.636910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:05.636910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:05.636910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:05.636910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:05.636910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:05.636910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:05.636910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:05.636910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:05.636910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 265/540] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:05.641879 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5007e-449a-418a-bcdb-11dc54546eaf None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:05.663627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f74b05fa-4ff6-49a1-902f-879010817442 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:05.664861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f74b05fa-4ff6-49a1-902f-879010817442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:05.811668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 276/541] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:02:05.821675 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5007e-449a-418a-bcdb-11dc54546eaf None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:05.839024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:05.856283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b05fa-4ff6-49a1-902f-879010817442 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:05.898593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66debd8c-2279-495e-bacf-534f3539b056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:05.899191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66debd8c-2279-495e-bacf-534f3539b056 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:05.899481 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66debd8c-2279-495e-bacf-534f3539b056 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:05.899760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66debd8c-2279-495e-bacf-534f3539b056 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:05.900579 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66debd8c-2279-495e-bacf-534f3539b056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:05.900891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66debd8c-2279-495e-bacf-534f3539b056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:05.902335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66debd8c-2279-495e-bacf-534f3539b056 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:05.919610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:05.928307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 266/542] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:05.936306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66debd8c-2279-495e-bacf-534f3539b056 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:06.029615 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b05fa-4ff6-49a1-902f-879010817442 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:06.057100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66debd8c-2279-495e-bacf-534f3539b056 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:06.103038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474301f3-c9fa-4981-9a67-72f4b8fddf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:06.103763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474301f3-c9fa-4981-9a67-72f4b8fddf66 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:06.103928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2238a3-5157-4067-97f7-6dea345f3205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:06.104384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474301f3-c9fa-4981-9a67-72f4b8fddf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:06.104384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474301f3-c9fa-4981-9a67-72f4b8fddf66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:06.105151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474301f3-c9fa-4981-9a67-72f4b8fddf66 None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=ae7551e9626541d49a1be9330094f42e) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:06.105458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474301f3-c9fa-4981-9a67-72f4b8fddf66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:06.105699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2238a3-5157-4067-97f7-6dea345f3205 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:06.106121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2238a3-5157-4067-97f7-6dea345f3205 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:06.106570 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2238a3-5157-4067-97f7-6dea345f3205 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:06.106923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474301f3-c9fa-4981-9a67-72f4b8fddf66 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:06.118003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2238a3-5157-4067-97f7-6dea345f3205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:06.122353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 267/543] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:05 2022] GET /identity/v3/role_assignments?user.id=ae7551e9626541d49a1be9330094f42e&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-dc2238a3-5157-4067-97f7-6dea345f3205 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:06.126809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:06.127938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:06.128947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:06.131402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 277/544] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:06.137167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474301f3-c9fa-4981-9a67-72f4b8fddf66 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:06.184140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:06.301221 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474301f3-c9fa-4981-9a67-72f4b8fddf66 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:06.358017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527e1f4-85c9-4d56-b761-4843d45a3468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:06.358702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527e1f4-85c9-4d56-b761-4843d45a3468 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:06.358988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527e1f4-85c9-4d56-b761-4843d45a3468 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:06.359265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527e1f4-85c9-4d56-b761-4843d45a3468 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:06.360049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527e1f4-85c9-4d56-b761-4843d45a3468 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:06.360360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527e1f4-85c9-4d56-b761-4843d45a3468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:06.361738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527e1f4-85c9-4d56-b761-4843d45a3468 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:06.377596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 268/545] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:06.388518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2238a3-5157-4067-97f7-6dea345f3205 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:06.536682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:06.546683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2238a3-5157-4067-97f7-6dea345f3205 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:06.595524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c02e4-05c0-4c2e-9108-0677c266acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:06.596387 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c02e4-05c0-4c2e-9108-0677c266acbd None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:06.596669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c02e4-05c0-4c2e-9108-0677c266acbd None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:06.596944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c02e4-05c0-4c2e-9108-0677c266acbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:06.609705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c02e4-05c0-4c2e-9108-0677c266acbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:06.617615 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c02e4-05c0-4c2e-9108-0677c266acbd None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-965c02e4-05c0-4c2e-9108-0677c266acbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:06.642240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:06.643138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:06.644638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:06.644638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:06.644638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:06.644638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:06.644638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 278/546] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:06.649098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527e1f4-85c9-4d56-b761-4843d45a3468 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:06.834356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:06.865587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527e1f4-85c9-4d56-b761-4843d45a3468 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:06.922465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57199e4f-c2e7-4a0e-a5f8-023d3620d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:06.923258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199e4f-c2e7-4a0e-a5f8-023d3620d047 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:06.923438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199e4f-c2e7-4a0e-a5f8-023d3620d047 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:06.923701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199e4f-c2e7-4a0e-a5f8-023d3620d047 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:06.924465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57199e4f-c2e7-4a0e-a5f8-023d3620d047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:06.924775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57199e4f-c2e7-4a0e-a5f8-023d3620d047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:06.926151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57199e4f-c2e7-4a0e-a5f8-023d3620d047 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:06.949594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 269/547] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:06.954821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c02e4-05c0-4c2e-9108-0677c266acbd None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:06.980403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f72e-5305-4eb7-ba47-3c3fcca169be None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:06.980705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f72e-5305-4eb7-ba47-3c3fcca169be None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:06.980978 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f72e-5305-4eb7-ba47-3c3fcca169be None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:06.983158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 270/548] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:02:06.988697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4aaf1-0f6e-434f-a6eb-fd7b56779586 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:06.988976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4aaf1-0f6e-434f-a6eb-fd7b56779586 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:06.989261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4aaf1-0f6e-434f-a6eb-fd7b56779586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:07.021013 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-69c4aaf1-0f6e-434f-a6eb-fd7b56779586 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:07.022247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-69c4aaf1-0f6e-434f-a6eb-fd7b56779586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:07.115662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c02e4-05c0-4c2e-9108-0677c266acbd None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:07.121108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 271/549] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:07.159470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4aaf1-0f6e-434f-a6eb-fd7b56779586 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:07.159658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b84cb-39cc-403b-9bd0-74638a3e62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:07.160772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b84cb-39cc-403b-9bd0-74638a3e62ce None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:07.161281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b84cb-39cc-403b-9bd0-74638a3e62ce None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:07.161897 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b84cb-39cc-403b-9bd0-74638a3e62ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:07.171029 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b84cb-39cc-403b-9bd0-74638a3e62ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:07.172939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b84cb-39cc-403b-9bd0-74638a3e62ce None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-ca5b84cb-39cc-403b-9bd0-74638a3e62ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:07.188704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:07.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:07.190539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:07.190539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:07.190539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:07.190539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:07.190539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:07.190539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:07.190539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:07.190539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:07.190539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:07.190539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:07.193246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 279/550] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:07.194807 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef436-a897-4d42-8f36-ddccbbe7515a None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:07.195361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef436-a897-4d42-8f36-ddccbbe7515a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:07.195843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef436-a897-4d42-8f36-ddccbbe7515a None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:07.197706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 280/551] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:07.199521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ef436-a897-4d42-8f36-ddccbbe7515a None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:07.209013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:07.245068 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:07.269609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4aaf1-0f6e-434f-a6eb-fd7b56779586 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:07.307506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730f0b5-9d17-4d14-a74d-b7dbb5e1b955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:07.308326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730f0b5-9d17-4d14-a74d-b7dbb5e1b955 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:07.308612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730f0b5-9d17-4d14-a74d-b7dbb5e1b955 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:07.308887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730f0b5-9d17-4d14-a74d-b7dbb5e1b955 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:07.311203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ef436-a897-4d42-8f36-ddccbbe7515a None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:07.320463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730f0b5-9d17-4d14-a74d-b7dbb5e1b955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-9730f0b5-9d17-4d14-a74d-b7dbb5e1b955 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:07.328942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:07.330039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:07.330992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 272/552] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:07.336329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7a0d-2e83-4167-98ed-f2596ec61d96 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:07.336329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7a0d-2e83-4167-98ed-f2596ec61d96 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:07.336329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7a0d-2e83-4167-98ed-f2596ec61d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:07.350600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-484c7a0d-2e83-4167-98ed-f2596ec61d96 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:07.352058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-484c7a0d-2e83-4167-98ed-f2596ec61d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:07.357750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe158-d552-4b5a-a04d-ec57836c92ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:07.358684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe158-d552-4b5a-a04d-ec57836c92ec None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:07.359215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe158-d552-4b5a-a04d-ec57836c92ec None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:07.359639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe158-d552-4b5a-a04d-ec57836c92ec None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:07.360770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befe158-d552-4b5a-a04d-ec57836c92ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:07.361274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befe158-d552-4b5a-a04d-ec57836c92ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:07.362965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befe158-d552-4b5a-a04d-ec57836c92ec None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:07.382556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 281/553] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Jun 2 13:02:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:07.383624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe158-d552-4b5a-a04d-ec57836c92ec None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:07.443905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 273/554] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:07.443905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7a0d-2e83-4167-98ed-f2596ec61d96 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:07.464903 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:07.515107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:07.522695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe158-d552-4b5a-a04d-ec57836c92ec None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:07.551723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7a0d-2e83-4167-98ed-f2596ec61d96 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:07.572899 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeab89-d8e7-49f7-a88e-061cddfe24f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:07.573815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeab89-d8e7-49f7-a88e-061cddfe24f7 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:07.574270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeab89-d8e7-49f7-a88e-061cddfe24f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:07.574688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeab89-d8e7-49f7-a88e-061cddfe24f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:07.576768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eeab89-d8e7-49f7-a88e-061cddfe24f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:07.577359 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eeab89-d8e7-49f7-a88e-061cddfe24f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:07.579269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eeab89-d8e7-49f7-a88e-061cddfe24f7 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:07.591806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 282/555] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:07.592994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeab89-d8e7-49f7-a88e-061cddfe24f7 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:07.598584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec8593-a2c8-490c-9db1-ef9fbee83428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:07.599264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec8593-a2c8-490c-9db1-ef9fbee83428 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:07.599549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec8593-a2c8-490c-9db1-ef9fbee83428 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:07.599825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec8593-a2c8-490c-9db1-ef9fbee83428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:07.691654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec8593-a2c8-490c-9db1-ef9fbee83428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:07.693733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec8593-a2c8-490c-9db1-ef9fbee83428 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:07.717950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeab89-d8e7-49f7-a88e-061cddfe24f7 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:07.745012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:07.754845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6778b60-ef12-4c1f-914e-432cbfd4fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:07.758992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778b60-ef12-4c1f-914e-432cbfd4fa02 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:07.758992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778b60-ef12-4c1f-914e-432cbfd4fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:07.758992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778b60-ef12-4c1f-914e-432cbfd4fa02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:07.768591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6778b60-ef12-4c1f-914e-432cbfd4fa02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:07.775297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-b6778b60-ef12-4c1f-914e-432cbfd4fa02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:07.778019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:07.779507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:07.780373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:07.782820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 283/556] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:07.783955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6778b60-ef12-4c1f-914e-432cbfd4fa02 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:07.828288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 274/557] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:07.829459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec8593-a2c8-490c-9db1-ef9fbee83428 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:07.913414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6778b60-ef12-4c1f-914e-432cbfd4fa02 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:07.957724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b86333-28ad-4533-a8b4-6779cd00b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:07.958435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b86333-28ad-4533-a8b4-6779cd00b81c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:07.958721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b86333-28ad-4533-a8b4-6779cd00b81c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:07.958999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b86333-28ad-4533-a8b4-6779cd00b81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:07.966689 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec8593-a2c8-490c-9db1-ef9fbee83428 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:07.970760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b86333-28ad-4533-a8b4-6779cd00b81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:07.975991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b86333-28ad-4533-a8b4-6779cd00b81c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-80b86333-28ad-4533-a8b4-6779cd00b81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:07.997622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:07.999033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:08.000017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:08.000017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:08.000017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:08.000017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:08.000017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 284/558] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:08.000017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b86333-28ad-4533-a8b4-6779cd00b81c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.021849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc14eba-37fa-419b-8e19-bb072c97032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.022576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc14eba-37fa-419b-8e19-bb072c97032b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.022862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc14eba-37fa-419b-8e19-bb072c97032b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.023133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc14eba-37fa-419b-8e19-bb072c97032b None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.023930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc14eba-37fa-419b-8e19-bb072c97032b None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:08.024653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc14eba-37fa-419b-8e19-bb072c97032b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:08.026030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc14eba-37fa-419b-8e19-bb072c97032b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:08.034547 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 275/559] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:08.035659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce784d-32ae-4afc-a7fc-b8586da739ed None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.035986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce784d-32ae-4afc-a7fc-b8586da739ed None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.036277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce784d-32ae-4afc-a7fc-b8586da739ed None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.039993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 276/560] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:08.039993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce784d-32ae-4afc-a7fc-b8586da739ed None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.050326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:08.070096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:08.116761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b86333-28ad-4533-a8b4-6779cd00b81c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:08.147271 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce784d-32ae-4afc-a7fc-b8586da739ed None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:08.153451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad84eb9-0088-460b-b8df-88cbdb397698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.154258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad84eb9-0088-460b-b8df-88cbdb397698 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.154931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad84eb9-0088-460b-b8df-88cbdb397698 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.154931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad84eb9-0088-460b-b8df-88cbdb397698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.167418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad84eb9-0088-460b-b8df-88cbdb397698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:08.169988 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad84eb9-0088-460b-b8df-88cbdb397698 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:08.183539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60f399-63b9-4058-b0f8-501487794024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.184782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f399-63b9-4058-b0f8-501487794024 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.185068 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f399-63b9-4058-b0f8-501487794024 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.185344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f399-63b9-4058-b0f8-501487794024 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.186090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60f399-63b9-4058-b0f8-501487794024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:08.186381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60f399-63b9-4058-b0f8-501487794024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:08.187759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60f399-63b9-4058-b0f8-501487794024 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-8ad84eb9-0088-460b-b8df-88cbdb397698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:08.194558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:08.195531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:08.196461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:08.196461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:08.196461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:08.196461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:08.197332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 285/561] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:08.198047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad84eb9-0088-460b-b8df-88cbdb397698 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.203990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 277/562] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:08.205732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116de90-505c-4099-bf48-47e71e692673 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.206337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116de90-505c-4099-bf48-47e71e692673 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.206820 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116de90-505c-4099-bf48-47e71e692673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.224444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-e116de90-505c-4099-bf48-47e71e692673 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:08.225564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e116de90-505c-4099-bf48-47e71e692673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:08.296339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:08.311896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 278/563] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:08.311896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116de90-505c-4099-bf48-47e71e692673 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.316629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad84eb9-0088-460b-b8df-88cbdb397698 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:08.342755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:08.358003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb60d35-961e-4b03-9fce-2ed7ede3a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.358802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb60d35-961e-4b03-9fce-2ed7ede3a67d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.359092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb60d35-961e-4b03-9fce-2ed7ede3a67d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.359366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb60d35-961e-4b03-9fce-2ed7ede3a67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.370316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb60d35-961e-4b03-9fce-2ed7ede3a67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:08.372463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb60d35-961e-4b03-9fce-2ed7ede3a67d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-1bb60d35-961e-4b03-9fce-2ed7ede3a67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:08.395260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:08.396352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:08.397236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:08.397236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:08.397236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:08.397236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:08.397236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 286/564] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:08.397975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb60d35-961e-4b03-9fce-2ed7ede3a67d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.439087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116de90-505c-4099-bf48-47e71e692673 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:08.474980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b216680-6d8b-4164-b60f-854657c42e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.475576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b216680-6d8b-4164-b60f-854657c42e18 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.475856 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b216680-6d8b-4164-b60f-854657c42e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.476159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b216680-6d8b-4164-b60f-854657c42e18 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.476885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b216680-6d8b-4164-b60f-854657c42e18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:08.477190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b216680-6d8b-4164-b60f-854657c42e18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:08.478609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b216680-6d8b-4164-b60f-854657c42e18 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:08.491792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 279/565] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:08.492670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b216680-6d8b-4164-b60f-854657c42e18 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.519338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb60d35-961e-4b03-9fce-2ed7ede3a67d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:08.556727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c9114-4337-44f0-bab9-5b337e359240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.557519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c9114-4337-44f0-bab9-5b337e359240 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.557850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c9114-4337-44f0-bab9-5b337e359240 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.558125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c9114-4337-44f0-bab9-5b337e359240 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.567237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c9114-4337-44f0-bab9-5b337e359240 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:08.568698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c9114-4337-44f0-bab9-5b337e359240 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:08.573372 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-b41c9114-4337-44f0-bab9-5b337e359240 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:08.583906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:08.584862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:08.585772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 287/566] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:08.586362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c9114-4337-44f0-bab9-5b337e359240 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.590145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:08.598775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b216680-6d8b-4164-b60f-854657c42e18 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:08.635097 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b710a22-b3ef-4f01-9d65-cd01d40366e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.635920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b710a22-b3ef-4f01-9d65-cd01d40366e1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.636208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b710a22-b3ef-4f01-9d65-cd01d40366e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.636540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b710a22-b3ef-4f01-9d65-cd01d40366e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.647322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b710a22-b3ef-4f01-9d65-cd01d40366e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-8b710a22-b3ef-4f01-9d65-cd01d40366e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:08.655729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:08.656795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:08.657610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 280/567] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:08.658271 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b710a22-b3ef-4f01-9d65-cd01d40366e1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.698616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c9114-4337-44f0-bab9-5b337e359240 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:08.735765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbdf85-489f-44c1-84ef-8955e022ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.736752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbdf85-489f-44c1-84ef-8955e022ad90 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.737183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbdf85-489f-44c1-84ef-8955e022ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.737606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbdf85-489f-44c1-84ef-8955e022ad90 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.738469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbdf85-489f-44c1-84ef-8955e022ad90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:08.738943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbdf85-489f-44c1-84ef-8955e022ad90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:08.740342 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbdf85-489f-44c1-84ef-8955e022ad90 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:08.752916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 288/568] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:08.753726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbdf85-489f-44c1-84ef-8955e022ad90 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.770537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b710a22-b3ef-4f01-9d65-cd01d40366e1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:08.807370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4e2c1-5ae7-4fce-982e-8be8591b07c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.808201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4e2c1-5ae7-4fce-982e-8be8591b07c2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.808492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4e2c1-5ae7-4fce-982e-8be8591b07c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.808773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4e2c1-5ae7-4fce-982e-8be8591b07c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.815596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4e2c1-5ae7-4fce-982e-8be8591b07c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:08.817001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4e2c1-5ae7-4fce-982e-8be8591b07c2 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:08.818850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:08.818963 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-1fe4e2c1-5ae7-4fce-982e-8be8591b07c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:08.831716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:08.834811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:08.835944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:08.835944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:08.835944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:08.835944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:08.835944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:08.835944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:08.835944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:08.835944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:08.835944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 281/569] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:08.835944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4e2c1-5ae7-4fce-982e-8be8591b07c2 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.859395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbdf85-489f-44c1-84ef-8955e022ad90 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:08.892235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf92a3-d9b5-4966-adec-02e58688762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.892901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf92a3-d9b5-4966-adec-02e58688762a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.893178 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf92a3-d9b5-4966-adec-02e58688762a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.893446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf92a3-d9b5-4966-adec-02e58688762a None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.894272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf92a3-d9b5-4966-adec-02e58688762a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:08.894577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf92a3-d9b5-4966-adec-02e58688762a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:08.896069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf92a3-d9b5-4966-adec-02e58688762a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:08.914682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 289/570] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:08.915427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf92a3-d9b5-4966-adec-02e58688762a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:08.932071 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4e2c1-5ae7-4fce-982e-8be8591b07c2 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:08.967056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6347edc-2ced-473f-8a5c-01fe64700675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:08.967739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347edc-2ced-473f-8a5c-01fe64700675 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.968070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347edc-2ced-473f-8a5c-01fe64700675 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.968350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347edc-2ced-473f-8a5c-01fe64700675 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.969089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347edc-2ced-473f-8a5c-01fe64700675 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:08.969387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347edc-2ced-473f-8a5c-01fe64700675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:08.970761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347edc-2ced-473f-8a5c-01fe64700675 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:08.979018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 282/571] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:08.980200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd610af6-6064-4532-9b10-adb152b2bf3c None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:08.980487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd610af6-6064-4532-9b10-adb152b2bf3c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:08.980771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd610af6-6064-4532-9b10-adb152b2bf3c None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:08.982033 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 283/572] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:08.982735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd610af6-6064-4532-9b10-adb152b2bf3c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.017251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf92a3-d9b5-4966-adec-02e58688762a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.037721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:09.042302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:09.051441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2a3ed-4239-44a9-a688-491a7cfbd046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.052263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a3ed-4239-44a9-a688-491a7cfbd046 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.052543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a3ed-4239-44a9-a688-491a7cfbd046 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.052823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a3ed-4239-44a9-a688-491a7cfbd046 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.059768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2a3ed-4239-44a9-a688-491a7cfbd046 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:09.061298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2a3ed-4239-44a9-a688-491a7cfbd046 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-29e2a3ed-4239-44a9-a688-491a7cfbd046 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:09.076910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:09.080130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 290/573] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:09.081048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2a3ed-4239-44a9-a688-491a7cfbd046 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.083530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd610af6-6064-4532-9b10-adb152b2bf3c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.116356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0a5b1-2273-400f-84f4-f13eeee3c3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.117005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0a5b1-2273-400f-84f4-f13eeee3c3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.117285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0a5b1-2273-400f-84f4-f13eeee3c3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.117559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0a5b1-2273-400f-84f4-f13eeee3c3a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.118325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0a5b1-2273-400f-84f4-f13eeee3c3a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:09.118628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0a5b1-2273-400f-84f4-f13eeee3c3a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:09.120074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0a5b1-2273-400f-84f4-f13eeee3c3a9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:09.132631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 284/574] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:09.133439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0a5b1-2273-400f-84f4-f13eeee3c3a9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.182728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2a3ed-4239-44a9-a688-491a7cfbd046 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.217049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c52ff6-b888-415b-9343-c3a1e777cb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.217893 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c52ff6-b888-415b-9343-c3a1e777cb2d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.218175 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c52ff6-b888-415b-9343-c3a1e777cb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.218448 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c52ff6-b888-415b-9343-c3a1e777cb2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.228679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c52ff6-b888-415b-9343-c3a1e777cb2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:09.230200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c52ff6-b888-415b-9343-c3a1e777cb2d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:09.230720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0a5b1-2273-400f-84f4-f13eeee3c3a9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-56c52ff6-b888-415b-9343-c3a1e777cb2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:09.248140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:09.249233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:09.250139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:09.250139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:09.250139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:09.250139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:09.250139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 291/575] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:09.250658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9c85-9750-4b57-aecf-ebb9eff2807e None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.250889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9c85-9750-4b57-aecf-ebb9eff2807e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.251070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9c85-9750-4b57-aecf-ebb9eff2807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.251457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:09.267445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-050b9c85-9750-4b57-aecf-ebb9eff2807e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:09.267954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bdfe1-aa1f-4eee-ae5a-2ab641fb4ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.268582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-050b9c85-9750-4b57-aecf-ebb9eff2807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:09.268750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bdfe1-aa1f-4eee-ae5a-2ab641fb4ddb None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.269029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bdfe1-aa1f-4eee-ae5a-2ab641fb4ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.269303 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bdfe1-aa1f-4eee-ae5a-2ab641fb4ddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.279965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bdfe1-aa1f-4eee-ae5a-2ab641fb4ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:09.281727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bdfe1-aa1f-4eee-ae5a-2ab641fb4ddb None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:09.294832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-e49bdfe1-aa1f-4eee-ae5a-2ab641fb4ddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:09.299715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:09.300655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:09.301537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:09.301537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:09.301537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:09.301537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:09.301537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 285/576] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:09.301871 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bdfe1-aa1f-4eee-ae5a-2ab641fb4ddb None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.341157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 292/577] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:09.342016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b9c85-9750-4b57-aecf-ebb9eff2807e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.407766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bdfe1-aa1f-4eee-ae5a-2ab641fb4ddb None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.440743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb09384-2810-40ff-968c-e5b0339414fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.441415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb09384-2810-40ff-968c-e5b0339414fa None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.441697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb09384-2810-40ff-968c-e5b0339414fa None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.441971 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb09384-2810-40ff-968c-e5b0339414fa None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.442803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb09384-2810-40ff-968c-e5b0339414fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:09.443107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb09384-2810-40ff-968c-e5b0339414fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:09.443842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b9c85-9750-4b57-aecf-ebb9eff2807e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.444566 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb09384-2810-40ff-968c-e5b0339414fa None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:09.462577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 286/578] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Jun 2 13:02:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:09.463410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb09384-2810-40ff-968c-e5b0339414fa None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.480780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfa6db-96e6-4a08-bb84-1c483e4af15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.481473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa6db-96e6-4a08-bb84-1c483e4af15e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.481763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa6db-96e6-4a08-bb84-1c483e4af15e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.482039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa6db-96e6-4a08-bb84-1c483e4af15e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.482879 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfa6db-96e6-4a08-bb84-1c483e4af15e None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=bb4d690feb01473eaee368408c8a1dab) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:09.483192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfa6db-96e6-4a08-bb84-1c483e4af15e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:09.484673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfa6db-96e6-4a08-bb84-1c483e4af15e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:09.490048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 293/579] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:09 2022] GET /identity/v3/role_assignments?user.id=bb4d690feb01473eaee368408c8a1dab&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:09.491091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfa6db-96e6-4a08-bb84-1c483e4af15e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.494122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:09.532999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:09.575813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb09384-2810-40ff-968c-e5b0339414fa None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.617205 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfa6db-96e6-4a08-bb84-1c483e4af15e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.618332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5bd97-ca9c-48c2-beb8-0d4cef323d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.619357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5bd97-ca9c-48c2-beb8-0d4cef323d9c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.619678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5bd97-ca9c-48c2-beb8-0d4cef323d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.620967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5bd97-ca9c-48c2-beb8-0d4cef323d9c None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.622253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5bd97-ca9c-48c2-beb8-0d4cef323d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:09.622564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5bd97-ca9c-48c2-beb8-0d4cef323d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:09.623989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5bd97-ca9c-48c2-beb8-0d4cef323d9c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:09.640071 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 287/580] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:09.640975 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5bd97-ca9c-48c2-beb8-0d4cef323d9c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.659585 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64dd9b-6275-4815-aaa4-7a6c17ef38ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.660407 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64dd9b-6275-4815-aaa4-7a6c17ef38ea None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.660694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64dd9b-6275-4815-aaa4-7a6c17ef38ea None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.660993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64dd9b-6275-4815-aaa4-7a6c17ef38ea None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.661714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64dd9b-6275-4815-aaa4-7a6c17ef38ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:09.662024 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64dd9b-6275-4815-aaa4-7a6c17ef38ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:09.663454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64dd9b-6275-4815-aaa4-7a6c17ef38ea None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:09.676340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 294/581] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:09.681619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64dd9b-6275-4815-aaa4-7a6c17ef38ea None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.741234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:09.751708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5bd97-ca9c-48c2-beb8-0d4cef323d9c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.773337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:09.802625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64dd9b-6275-4815-aaa4-7a6c17ef38ea None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.802804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845b8a4-6dd6-4ffa-a68e-94cc94101647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.803635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845b8a4-6dd6-4ffa-a68e-94cc94101647 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.804173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845b8a4-6dd6-4ffa-a68e-94cc94101647 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.813564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845b8a4-6dd6-4ffa-a68e-94cc94101647 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.820357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845b8a4-6dd6-4ffa-a68e-94cc94101647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-9845b8a4-6dd6-4ffa-a68e-94cc94101647 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:09.829719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:09.830761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:09.831576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:09.835866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 288/582] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:09.836753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845b8a4-6dd6-4ffa-a68e-94cc94101647 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.842905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e687c3-fa23-47d9-8512-e2b92a085f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.843848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e687c3-fa23-47d9-8512-e2b92a085f40 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.844230 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e687c3-fa23-47d9-8512-e2b92a085f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.844583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e687c3-fa23-47d9-8512-e2b92a085f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:09.857482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e687c3-fa23-47d9-8512-e2b92a085f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:09.859060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e687c3-fa23-47d9-8512-e2b92a085f40 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-a1e687c3-fa23-47d9-8512-e2b92a085f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:09.877911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:09.878823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:09.879684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:09.879684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:09.879684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:09.879684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:09.883987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 295/583] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:09.884948 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e687c3-fa23-47d9-8512-e2b92a085f40 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:09.947275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845b8a4-6dd6-4ffa-a68e-94cc94101647 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:09.987899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86f0f2-cda9-49d9-850f-09bb6cdddd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:09.989028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86f0f2-cda9-49d9-850f-09bb6cdddd58 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:09.989316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86f0f2-cda9-49d9-850f-09bb6cdddd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:09.989594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86f0f2-cda9-49d9-850f-09bb6cdddd58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.000403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86f0f2-cda9-49d9-850f-09bb6cdddd58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.000617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e687c3-fa23-47d9-8512-e2b92a085f40 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:10.001872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86f0f2-cda9-49d9-850f-09bb6cdddd58 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-ba86f0f2-cda9-49d9-850f-09bb6cdddd58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:10.018787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:10.019734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:10.020650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:10.020650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:10.020650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:10.020650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:10.020650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:10.020650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:10.020650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:10.020650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:10.024738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 289/584] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:10.025936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86f0f2-cda9-49d9-850f-09bb6cdddd58 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:10.041265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:10.046748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfe289-2aeb-4803-aaf5-c16ebaa91a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:10.048351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfe289-2aeb-4803-aaf5-c16ebaa91a90 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:10.049386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfe289-2aeb-4803-aaf5-c16ebaa91a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:10.050096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfe289-2aeb-4803-aaf5-c16ebaa91a90 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.061611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfe289-2aeb-4803-aaf5-c16ebaa91a90 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.063398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfe289-2aeb-4803-aaf5-c16ebaa91a90 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:10.065421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-04cfe289-2aeb-4803-aaf5-c16ebaa91a90 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:10.078743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:10.079918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:10.081059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:10.081059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:10.081059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:10.081059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:10.081059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:10.081059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:10.081059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:10.081059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:10.081059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:02:10.081059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:10.084861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 296/585] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:10.085789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfe289-2aeb-4803-aaf5-c16ebaa91a90 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:10.183237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86f0f2-cda9-49d9-850f-09bb6cdddd58 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:10.207401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfe289-2aeb-4803-aaf5-c16ebaa91a90 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:10.225427 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60765216-c49e-4cb1-8ceb-ba7620fee7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:10.226106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765216-c49e-4cb1-8ceb-ba7620fee7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:10.226384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765216-c49e-4cb1-8ceb-ba7620fee7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:10.226666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765216-c49e-4cb1-8ceb-ba7620fee7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.227500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60765216-c49e-4cb1-8ceb-ba7620fee7d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:10.227825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60765216-c49e-4cb1-8ceb-ba7620fee7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.229207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60765216-c49e-4cb1-8ceb-ba7620fee7d2 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:10.243943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 290/586] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:10.243943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60765216-c49e-4cb1-8ceb-ba7620fee7d2 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:10.258940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca0cb2-12de-4c41-805d-02ec63614f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:10.259713 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0cb2-12de-4c41-805d-02ec63614f9a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:10.260089 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0cb2-12de-4c41-805d-02ec63614f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:10.260436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca0cb2-12de-4c41-805d-02ec63614f9a None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.261234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca0cb2-12de-4c41-805d-02ec63614f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:10.261606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca0cb2-12de-4c41-805d-02ec63614f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.263084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca0cb2-12de-4c41-805d-02ec63614f9a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:10.277147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 297/587] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:10.278674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca0cb2-12de-4c41-805d-02ec63614f9a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:10.321211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:10.346075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:10.351141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60765216-c49e-4cb1-8ceb-ba7620fee7d2 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:10.389376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff479d2-ad47-488e-a55c-e3200e38e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:10.390045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff479d2-ad47-488e-a55c-e3200e38e8ce None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:10.390250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca0cb2-12de-4c41-805d-02ec63614f9a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:10.390364 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff479d2-ad47-488e-a55c-e3200e38e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:10.390598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff479d2-ad47-488e-a55c-e3200e38e8ce None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.393950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff479d2-ad47-488e-a55c-e3200e38e8ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:10.393950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff479d2-ad47-488e-a55c-e3200e38e8ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.393950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff479d2-ad47-488e-a55c-e3200e38e8ce None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:10.407167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 291/588] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:10.408880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff479d2-ad47-488e-a55c-e3200e38e8ce None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:10.438826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b9fed-a74e-4c40-adfa-e5eefe4e14e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:10.439506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b9fed-a74e-4c40-adfa-e5eefe4e14e6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:10.439787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b9fed-a74e-4c40-adfa-e5eefe4e14e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:10.440166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b9fed-a74e-4c40-adfa-e5eefe4e14e6 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.441006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b9fed-a74e-4c40-adfa-e5eefe4e14e6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:10.441312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b9fed-a74e-4c40-adfa-e5eefe4e14e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.442740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b9fed-a74e-4c40-adfa-e5eefe4e14e6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:10.466345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 298/589] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Jun 2 13:02:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:10.467053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b9fed-a74e-4c40-adfa-e5eefe4e14e6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:10.517988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff479d2-ad47-488e-a55c-e3200e38e8ce None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:10.550176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:10.555425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4c5c5-ab86-43c8-9774-18bada9e59cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:10.556258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4c5c5-ab86-43c8-9774-18bada9e59cd None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:10.556539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4c5c5-ab86-43c8-9774-18bada9e59cd None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:10.556812 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4c5c5-ab86-43c8-9774-18bada9e59cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.567133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4c5c5-ab86-43c8-9774-18bada9e59cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.573218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4c5c5-ab86-43c8-9774-18bada9e59cd None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:10.574364 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b9fed-a74e-4c40-adfa-e5eefe4e14e6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-87c4c5c5-ab86-43c8-9774-18bada9e59cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:10.587249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:10.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:10.589212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:10.589212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:10.589212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:10.589212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:10.589212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 292/590] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:10.589511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4c5c5-ab86-43c8-9774-18bada9e59cd None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:10.596712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:10.616431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28f99-ed43-4332-827b-3b049882a2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:10.617394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28f99-ed43-4332-827b-3b049882a2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:10.617690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28f99-ed43-4332-827b-3b049882a2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:10.617970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28f99-ed43-4332-827b-3b049882a2d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.625115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e28f99-ed43-4332-827b-3b049882a2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.626768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e28f99-ed43-4332-827b-3b049882a2d9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-d6e28f99-ed43-4332-827b-3b049882a2d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:10.645757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:10.646777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:10.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:10.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:10.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:10.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:10.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:10.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:10.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:10.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:10.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 299/591] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:10.653650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28f99-ed43-4332-827b-3b049882a2d9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:10.705168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4c5c5-ab86-43c8-9774-18bada9e59cd None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:10.741875 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517e73-9705-4004-bac3-6b7e70c3de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:10.742771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517e73-9705-4004-bac3-6b7e70c3de01 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:10.743059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517e73-9705-4004-bac3-6b7e70c3de01 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:10.743334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517e73-9705-4004-bac3-6b7e70c3de01 None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/ae1c6084061f4434864e9f7bcc553733/roles/268a1d65ee224ca3b6b59f003f936207` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.758736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5517e73-9705-4004-bac3-6b7e70c3de01 None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=ae1c6084061f4434864e9f7bcc553733, role_id=268a1d65ee224ca3b6b59f003f936207)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.760131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28f99-ed43-4332-827b-3b049882a2d9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:10.760257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5517e73-9705-4004-bac3-6b7e70c3de01 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:10.795374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26564d6a-a12f-45df-ab04-1c010b9a003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:10.796200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26564d6a-a12f-45df-ab04-1c010b9a003d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:10.796482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26564d6a-a12f-45df-ab04-1c010b9a003d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:10.796754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26564d6a-a12f-45df-ab04-1c010b9a003d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.807631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26564d6a-a12f-45df-ab04-1c010b9a003d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.809664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26564d6a-a12f-45df-ab04-1c010b9a003d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-26564d6a-a12f-45df-ab04-1c010b9a003d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:10.828339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:10.829446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:10.830458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:10.830458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:10.830458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:10.830458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:10.830458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 300/592] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:10.830748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26564d6a-a12f-45df-ab04-1c010b9a003d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:10.859240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:10.879454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 293/593] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:02:10 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/ae1c6084061f4434864e9f7bcc553733/roles/268a1d65ee224ca3b6b59f003f936207 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:02:10.880326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517e73-9705-4004-bac3-6b7e70c3de01 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:10.938980 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26564d6a-a12f-45df-ab04-1c010b9a003d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:10.939511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:10.979534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bbf54-d5e9-4864-ab0f-7130db7d8841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:10.980266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bbf54-d5e9-4864-ab0f-7130db7d8841 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:10.980669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bbf54-d5e9-4864-ab0f-7130db7d8841 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:10.981071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bbf54-d5e9-4864-ab0f-7130db7d8841 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:10.981811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bbf54-d5e9-4864-ab0f-7130db7d8841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:10.982121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bbf54-d5e9-4864-ab0f-7130db7d8841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:10.983590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bbf54-d5e9-4864-ab0f-7130db7d8841 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:11.002686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 301/594] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:11.003770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bbf54-d5e9-4864-ab0f-7130db7d8841 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:11.036462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517e73-9705-4004-bac3-6b7e70c3de01 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:11.088615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408214b-ba8f-4dd4-aa21-7deb777452f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:11.089759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408214b-ba8f-4dd4-aa21-7deb777452f4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:11.090253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408214b-ba8f-4dd4-aa21-7deb777452f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:11.091171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408214b-ba8f-4dd4-aa21-7deb777452f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:11.092966 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408214b-ba8f-4dd4-aa21-7deb777452f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:11.093806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408214b-ba8f-4dd4-aa21-7deb777452f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:11.096748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408214b-ba8f-4dd4-aa21-7deb777452f4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:11.111551 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 294/595] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:11.113119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408214b-ba8f-4dd4-aa21-7deb777452f4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:11.129837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:11.143612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bbf54-d5e9-4864-ab0f-7130db7d8841 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:11.181936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66945de5-6168-4cf7-83cb-7debc280a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:11.182819 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945de5-6168-4cf7-83cb-7debc280a09f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:11.183196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945de5-6168-4cf7-83cb-7debc280a09f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:11.183736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66945de5-6168-4cf7-83cb-7debc280a09f None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:11.185219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66945de5-6168-4cf7-83cb-7debc280a09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:11.185621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66945de5-6168-4cf7-83cb-7debc280a09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:11.187084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66945de5-6168-4cf7-83cb-7debc280a09f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:11.199563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 302/596] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:11.201298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66945de5-6168-4cf7-83cb-7debc280a09f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:11.226507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:11.234834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408214b-ba8f-4dd4-aa21-7deb777452f4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:11.282081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5694376-0687-49b4-8144-56634496c10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:11.283416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5694376-0687-49b4-8144-56634496c10a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:11.283889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5694376-0687-49b4-8144-56634496c10a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:11.284352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5694376-0687-49b4-8144-56634496c10a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:11.295521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5694376-0687-49b4-8144-56634496c10a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:11.297716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5694376-0687-49b4-8144-56634496c10a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-c5694376-0687-49b4-8144-56634496c10a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:11.318616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:11.319826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:11.321029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:11.321029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:11.321029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:11.321029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:11.321029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:11.321029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:11.321029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:11.321029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:11.321029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:02:11.321029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:11.324002 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 295/597] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:11.325128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5694376-0687-49b4-8144-56634496c10a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:11.325832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66945de5-6168-4cf7-83cb-7debc280a09f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:11.366086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6b59-58ef-4e37-80fd-4b5fc4c8fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:11.367153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6b59-58ef-4e37-80fd-4b5fc4c8fa14 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:11.367705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6b59-58ef-4e37-80fd-4b5fc4c8fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:11.368133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6b59-58ef-4e37-80fd-4b5fc4c8fa14 None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/979519f42f7d463bb2ee1d5b0bb72a45/roles/268a1d65ee224ca3b6b59f003f936207` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:11.386010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c6b59-58ef-4e37-80fd-4b5fc4c8fa14 None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=979519f42f7d463bb2ee1d5b0bb72a45, role_id=268a1d65ee224ca3b6b59f003f936207)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:11.387637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c6b59-58ef-4e37-80fd-4b5fc4c8fa14 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:11.449311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5694376-0687-49b4-8144-56634496c10a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:11.487015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07d4a5-b203-4c44-adb1-d6fa2551730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:11.487815 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07d4a5-b203-4c44-adb1-d6fa2551730c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:11.488129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07d4a5-b203-4c44-adb1-d6fa2551730c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:11.488404 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07d4a5-b203-4c44-adb1-d6fa2551730c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:11.495480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07d4a5-b203-4c44-adb1-d6fa2551730c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:11.497590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07d4a5-b203-4c44-adb1-d6fa2551730c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:11.508982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-9e07d4a5-b203-4c44-adb1-d6fa2551730c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:11.513188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:11.533768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:11.534660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:11.534660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:11.534660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:11.534660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:11.534660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:11.534660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:11.534660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:11.534660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:11.534660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 296/598] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:11.534660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07d4a5-b203-4c44-adb1-d6fa2551730c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:11.535191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 303/599] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:02:11 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/979519f42f7d463bb2ee1d5b0bb72a45/roles/268a1d65ee224ca3b6b59f003f936207 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:02:11.535191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6b59-58ef-4e37-80fd-4b5fc4c8fa14 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:11.542125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:11.772000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07d4a5-b203-4c44-adb1-d6fa2551730c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:11.778937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6b59-58ef-4e37-80fd-4b5fc4c8fa14 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:11.816249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123fe91-91d3-49c9-809d-f00c2de3afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:11.816927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123fe91-91d3-49c9-809d-f00c2de3afa9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:11.817224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123fe91-91d3-49c9-809d-f00c2de3afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:11.817503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123fe91-91d3-49c9-809d-f00c2de3afa9 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:11.818312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123fe91-91d3-49c9-809d-f00c2de3afa9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:11.818616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123fe91-91d3-49c9-809d-f00c2de3afa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:11.820112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123fe91-91d3-49c9-809d-f00c2de3afa9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:11.836899 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dfd22-3e92-4743-8ab0-767484a618b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:11.837890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dfd22-3e92-4743-8ab0-767484a618b0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:11.838394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dfd22-3e92-4743-8ab0-767484a618b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:11.838885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 297/600] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Jun 2 13:02:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:11.839132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dfd22-3e92-4743-8ab0-767484a618b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:11.840220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dfd22-3e92-4743-8ab0-767484a618b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:11.841259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dfd22-3e92-4743-8ab0-767484a618b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:11.843122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dfd22-3e92-4743-8ab0-767484a618b0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:11.844373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2a31-b110-4ff3-930d-d576a3eab8fb None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:11.844666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2a31-b110-4ff3-930d-d576a3eab8fb None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:11.844944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d2a31-b110-4ff3-930d-d576a3eab8fb None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:11.846534 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 298/601] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:11.850713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d2a31-b110-4ff3-930d-d576a3eab8fb None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:11.866244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 304/602] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:11.868102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467265fc-cc2b-40d5-b5e0-685e3ceb5afc None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:11.868592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467265fc-cc2b-40d5-b5e0-685e3ceb5afc None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:11.869103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467265fc-cc2b-40d5-b5e0-685e3ceb5afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:11.892608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-467265fc-cc2b-40d5-b5e0-685e3ceb5afc None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:11.894980 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-467265fc-cc2b-40d5-b5e0-685e3ceb5afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:11.937711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:11.958105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:11.979908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 305/603] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:11.979908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467265fc-cc2b-40d5-b5e0-685e3ceb5afc None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:11.993525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d2a31-b110-4ff3-930d-d576a3eab8fb None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:12.043066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108cc62-78e7-4374-a17d-b3edf66dbf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:12.045209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108cc62-78e7-4374-a17d-b3edf66dbf38 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:12.045721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108cc62-78e7-4374-a17d-b3edf66dbf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:12.046406 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108cc62-78e7-4374-a17d-b3edf66dbf38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:12.060860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108cc62-78e7-4374-a17d-b3edf66dbf38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:12.063072 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108cc62-78e7-4374-a17d-b3edf66dbf38 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-5108cc62-78e7-4374-a17d-b3edf66dbf38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:12.087297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:12.088280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:12.089148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:12.089148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:12.089148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:12.089148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:12.089873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 299/604] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:12.095119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108cc62-78e7-4374-a17d-b3edf66dbf38 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:12.105472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467265fc-cc2b-40d5-b5e0-685e3ceb5afc None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:12.144403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d7721-2e7d-4136-a35a-f54d3d5e6641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:12.145744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d7721-2e7d-4136-a35a-f54d3d5e6641 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:12.146347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d7721-2e7d-4136-a35a-f54d3d5e6641 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:12.146818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d7721-2e7d-4136-a35a-f54d3d5e6641 None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/c2bc11c0ef524d7ea5cb8704fbbfcbb2/roles/268a1d65ee224ca3b6b59f003f936207` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:12.163644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d7721-2e7d-4136-a35a-f54d3d5e6641 None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=c2bc11c0ef524d7ea5cb8704fbbfcbb2, role_id=268a1d65ee224ca3b6b59f003f936207)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:12.165523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d7721-2e7d-4136-a35a-f54d3d5e6641 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:12.209968 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108cc62-78e7-4374-a17d-b3edf66dbf38 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:12.236347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:12.247366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fde19-acce-4b1d-98eb-cb37dad4a88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:12.248265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fde19-acce-4b1d-98eb-cb37dad4a88d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:12.248576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fde19-acce-4b1d-98eb-cb37dad4a88d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:12.248854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fde19-acce-4b1d-98eb-cb37dad4a88d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:12.260136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fde19-acce-4b1d-98eb-cb37dad4a88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-f57fde19-acce-4b1d-98eb-cb37dad4a88d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:12.268913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:12.269930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:12.270779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:12.275034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 300/605] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:12.275988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fde19-acce-4b1d-98eb-cb37dad4a88d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:12.290639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 306/606] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:02:11 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/c2bc11c0ef524d7ea5cb8704fbbfcbb2/roles/268a1d65ee224ca3b6b59f003f936207 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:02:12.292636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d7721-2e7d-4136-a35a-f54d3d5e6641 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:12.355047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:12.424675 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fde19-acce-4b1d-98eb-cb37dad4a88d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:12.494318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d7721-2e7d-4136-a35a-f54d3d5e6641 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:12.495280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2428677-f1e9-4469-b6bd-15b032db89cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:12.496260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2428677-f1e9-4469-b6bd-15b032db89cd None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:12.497239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2428677-f1e9-4469-b6bd-15b032db89cd None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:12.497680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2428677-f1e9-4469-b6bd-15b032db89cd None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:12.498569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2428677-f1e9-4469-b6bd-15b032db89cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:12.499053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2428677-f1e9-4469-b6bd-15b032db89cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:12.500649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2428677-f1e9-4469-b6bd-15b032db89cd None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:12.514686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 301/607] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:12.520800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2428677-f1e9-4469-b6bd-15b032db89cd None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:12.573097 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:12.592671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5408855-4220-427a-b065-e44c6c6e1b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:12.593383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5408855-4220-427a-b065-e44c6c6e1b99 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:12.593675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5408855-4220-427a-b065-e44c6c6e1b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:12.593962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5408855-4220-427a-b065-e44c6c6e1b99 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:12.594748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5408855-4220-427a-b065-e44c6c6e1b99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:12.595064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5408855-4220-427a-b065-e44c6c6e1b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:12.596513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5408855-4220-427a-b065-e44c6c6e1b99 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:12.612122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 307/608] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:12.618404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5408855-4220-427a-b065-e44c6c6e1b99 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:12.648476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2428677-f1e9-4469-b6bd-15b032db89cd None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:12.716700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019677de-431e-42c3-ba71-28cc08a7b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:12.717819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019677de-431e-42c3-ba71-28cc08a7b1ba None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:12.718500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019677de-431e-42c3-ba71-28cc08a7b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:12.721631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019677de-431e-42c3-ba71-28cc08a7b1ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:12.732453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019677de-431e-42c3-ba71-28cc08a7b1ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:12.734813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019677de-431e-42c3-ba71-28cc08a7b1ba None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-019677de-431e-42c3-ba71-28cc08a7b1ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:12.768554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:12.769712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:12.770583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:12.770583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:12.770583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:12.770583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:12.770583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:12.770583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:12.770583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:12.770583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:12.774905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 302/609] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:12.782717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019677de-431e-42c3-ba71-28cc08a7b1ba None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:12.814676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:12.818758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5408855-4220-427a-b065-e44c6c6e1b99 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:12.917610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019677de-431e-42c3-ba71-28cc08a7b1ba None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:12.921183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63d058-53c3-464f-831f-3d06e06dd5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:12.921637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:12.922003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63d058-53c3-464f-831f-3d06e06dd5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:12.922295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63d058-53c3-464f-831f-3d06e06dd5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:12.922576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63d058-53c3-464f-831f-3d06e06dd5b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:12.953389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63d058-53c3-464f-831f-3d06e06dd5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:12.954606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63d058-53c3-464f-831f-3d06e06dd5b0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:12.957916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693f598-8c09-42c3-a7f7-7e1a959cf381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:12.958771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693f598-8c09-42c3-a7f7-7e1a959cf381 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:12.959201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693f598-8c09-42c3-a7f7-7e1a959cf381 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:12.959651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693f598-8c09-42c3-a7f7-7e1a959cf381 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:12.960772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693f598-8c09-42c3-a7f7-7e1a959cf381 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:12.961262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693f598-8c09-42c3-a7f7-7e1a959cf381 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:12.963120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693f598-8c09-42c3-a7f7-7e1a959cf381 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:12.980049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 303/610] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:12.986277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693f598-8c09-42c3-a7f7-7e1a959cf381 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-cd63d058-53c3-464f-831f-3d06e06dd5b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:12.998601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:12.999762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:13.001018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:13.001018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:13.001018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:13.001018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:13.002851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 308/611] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:13.013536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63d058-53c3-464f-831f-3d06e06dd5b0 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:13.170133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693f598-8c09-42c3-a7f7-7e1a959cf381 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:13.202169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63d058-53c3-464f-831f-3d06e06dd5b0 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:13.247339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1820a1-7a02-478e-a2f6-143aa733492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:13.248359 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1820a1-7a02-478e-a2f6-143aa733492a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:13.248744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1820a1-7a02-478e-a2f6-143aa733492a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:13.249122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1820a1-7a02-478e-a2f6-143aa733492a None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:13.249939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1820a1-7a02-478e-a2f6-143aa733492a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:13.250341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1820a1-7a02-478e-a2f6-143aa733492a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:13.251822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1820a1-7a02-478e-a2f6-143aa733492a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:13.260605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8088f-0a97-4b44-8555-12c9782c4bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:13.261526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8088f-0a97-4b44-8555-12c9782c4bef None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:13.261810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8088f-0a97-4b44-8555-12c9782c4bef None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:13.262144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8088f-0a97-4b44-8555-12c9782c4bef None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/ae7551e9626541d49a1be9330094f42e/roles/268a1d65ee224ca3b6b59f003f936207` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:13.267232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 309/612] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:13.273547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1820a1-7a02-478e-a2f6-143aa733492a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:13.290117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:13.304778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8088f-0a97-4b44-8555-12c9782c4bef None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=ae7551e9626541d49a1be9330094f42e, role_id=268a1d65ee224ca3b6b59f003f936207)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:13.306241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8088f-0a97-4b44-8555-12c9782c4bef None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:13.381940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1820a1-7a02-478e-a2f6-143aa733492a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:13.404903 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 304/613] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:02:12 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/ae7551e9626541d49a1be9330094f42e/roles/268a1d65ee224ca3b6b59f003f936207 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:02:13.407082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cd25f-8f71-4645-ba9c-9220da8541d7 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:13.407550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cd25f-8f71-4645-ba9c-9220da8541d7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:13.408014 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cd25f-8f71-4645-ba9c-9220da8541d7 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:13.415308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 305/614] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:13.417449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9687b5-dcd8-4a86-bb46-238c6e87a2eb None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:13.418156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9687b5-dcd8-4a86-bb46-238c6e87a2eb None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:13.418664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9687b5-dcd8-4a86-bb46-238c6e87a2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:13.428669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9191aea-6477-485e-afdb-588dea775eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:13.429639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9191aea-6477-485e-afdb-588dea775eff None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:13.430013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9191aea-6477-485e-afdb-588dea775eff None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:13.430379 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9191aea-6477-485e-afdb-588dea775eff None admin] PATH_INFO: `/v3/users/swift` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:13.439547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9191aea-6477-485e-afdb-588dea775eff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:13.441431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9191aea-6477-485e-afdb-588dea775eff None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:13.445133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-5a9687b5-dcd8-4a86-bb46-238c6e87a2eb None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:13.445133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5a9687b5-dcd8-4a86-bb46-238c6e87a2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:13.456091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-e9191aea-6477-485e-afdb-588dea775eff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:13.460569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:13.461583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:13.462514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:13.462514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:13.462514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:13.462514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:13.462514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:13.462514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:13.462514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:13.462514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:13.462514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:13.462514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:13.465433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 310/615] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:13.471334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9191aea-6477-485e-afdb-588dea775eff None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:13.537377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 306/616] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:13.562219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9687b5-dcd8-4a86-bb46-238c6e87a2eb None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:13.564212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:13.599756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9191aea-6477-485e-afdb-588dea775eff None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:13.640727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaee90b-4b67-43d4-9507-81a40eace675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:13.641808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaee90b-4b67-43d4-9507-81a40eace675 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:13.642296 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaee90b-4b67-43d4-9507-81a40eace675 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:13.642829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaee90b-4b67-43d4-9507-81a40eace675 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:13.643978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaee90b-4b67-43d4-9507-81a40eace675 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:13.644513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaee90b-4b67-43d4-9507-81a40eace675 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:13.646183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaee90b-4b67-43d4-9507-81a40eace675 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:13.666197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 311/617] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Jun 2 13:02:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:13.671263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9687b5-dcd8-4a86-bb46-238c6e87a2eb None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:13.672573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaee90b-4b67-43d4-9507-81a40eace675 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:13.706462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1000-2ac4-468f-a8d7-7969b14f6cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:13.707358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1000-2ac4-468f-a8d7-7969b14f6cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:13.707751 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1000-2ac4-468f-a8d7-7969b14f6cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:13.708153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1000-2ac4-468f-a8d7-7969b14f6cb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:13.729644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c1000-2ac4-468f-a8d7-7969b14f6cb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-425c1000-2ac4-468f-a8d7-7969b14f6cb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:13.745677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:13.747446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:13.748421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:13.752251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 307/618] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:13.762034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1000-2ac4-468f-a8d7-7969b14f6cb4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:13.768290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:13.842663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaee90b-4b67-43d4-9507-81a40eace675 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:13.876056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:13.882520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72febe9c-08f2-44a2-af25-f320102e1616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:13.883533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72febe9c-08f2-44a2-af25-f320102e1616 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:13.884038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72febe9c-08f2-44a2-af25-f320102e1616 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:13.884311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72febe9c-08f2-44a2-af25-f320102e1616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:13.887299 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1000-2ac4-468f-a8d7-7969b14f6cb4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:13.897057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72febe9c-08f2-44a2-af25-f320102e1616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:13.898549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72febe9c-08f2-44a2-af25-f320102e1616 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-72febe9c-08f2-44a2-af25-f320102e1616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:13.919113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:13.920164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:13.921046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:13.921046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:13.921046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:13.921046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:13.921046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 312/619] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:13.925992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72febe9c-08f2-44a2-af25-f320102e1616 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:13.931973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00341d7-f71d-44df-827e-490a666a1a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:13.932937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00341d7-f71d-44df-827e-490a666a1a20 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:13.933458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00341d7-f71d-44df-827e-490a666a1a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:13.933993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00341d7-f71d-44df-827e-490a666a1a20 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:13.935387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00341d7-f71d-44df-827e-490a666a1a20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:13.935940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00341d7-f71d-44df-827e-490a666a1a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:13.937920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00341d7-f71d-44df-827e-490a666a1a20 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:13.949230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 308/620] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:13.954848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00341d7-f71d-44df-827e-490a666a1a20 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:14.063998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:14.068420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00341d7-f71d-44df-827e-490a666a1a20 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:14.106617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f361-89ca-4146-8810-36c2ddefb657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:14.108337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f361-89ca-4146-8810-36c2ddefb657 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.109015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f361-89ca-4146-8810-36c2ddefb657 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.109507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f361-89ca-4146-8810-36c2ddefb657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.121952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f361-89ca-4146-8810-36c2ddefb657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:14.123863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f361-89ca-4146-8810-36c2ddefb657 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-5cb5f361-89ca-4146-8810-36c2ddefb657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:14.143531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:14.144498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:14.145379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:14.145379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:14.145379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:14.145379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:14.148704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 309/621] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:14.155266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f361-89ca-4146-8810-36c2ddefb657 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:14.176180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72febe9c-08f2-44a2-af25-f320102e1616 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:14.266219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7c209-0b1b-4331-b585-16e1042df011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:14.266895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7c209-0b1b-4331-b585-16e1042df011 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.267176 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7c209-0b1b-4331-b585-16e1042df011 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.267444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7c209-0b1b-4331-b585-16e1042df011 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.268204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7c209-0b1b-4331-b585-16e1042df011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:14.268506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7c209-0b1b-4331-b585-16e1042df011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:14.269896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7c209-0b1b-4331-b585-16e1042df011 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:14.285160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f361-89ca-4146-8810-36c2ddefb657 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:14.285662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 313/622] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:14.287028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970d435-3cf4-4da5-9b78-6e07824ff05b None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.287315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970d435-3cf4-4da5-9b78-6e07824ff05b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.287591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970d435-3cf4-4da5-9b78-6e07824ff05b None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.298318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 314/623] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:14.298318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970d435-3cf4-4da5-9b78-6e07824ff05b None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:14.311085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:14.333391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88affa3-3066-42f0-83e1-64805c15aa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:14.333391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88affa3-3066-42f0-83e1-64805c15aa93 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.333391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88affa3-3066-42f0-83e1-64805c15aa93 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.333391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88affa3-3066-42f0-83e1-64805c15aa93 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.333780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88affa3-3066-42f0-83e1-64805c15aa93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:14.333780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88affa3-3066-42f0-83e1-64805c15aa93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:14.333780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88affa3-3066-42f0-83e1-64805c15aa93 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:14.344715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 310/624] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:14.345975 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c5845-221c-4d05-a76b-a3aa493761a0 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.346265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c5845-221c-4d05-a76b-a3aa493761a0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.346539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c5845-221c-4d05-a76b-a3aa493761a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.355628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:14.368200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-ce3c5845-221c-4d05-a76b-a3aa493761a0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:14.369419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ce3c5845-221c-4d05-a76b-a3aa493761a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:14.435363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970d435-3cf4-4da5-9b78-6e07824ff05b None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:14.448399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 311/625] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:14.448399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c5845-221c-4d05-a76b-a3aa493761a0 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:14.493250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825f628-fb21-40c6-9462-c80ff4660593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:14.494078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f628-fb21-40c6-9462-c80ff4660593 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.494362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f628-fb21-40c6-9462-c80ff4660593 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.494748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f628-fb21-40c6-9462-c80ff4660593 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.502473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f628-fb21-40c6-9462-c80ff4660593 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:14.504293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f628-fb21-40c6-9462-c80ff4660593 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-c825f628-fb21-40c6-9462-c80ff4660593 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:14.520621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:14.521626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:14.522503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:14.522503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:14.522503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:14.522503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:14.522503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:14.522503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:14.522503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:14.522503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:14.522503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 315/626] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:14.523001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825f628-fb21-40c6-9462-c80ff4660593 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:14.571678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c5845-221c-4d05-a76b-a3aa493761a0 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:14.584920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:14.610732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9762-9fdd-4114-8dbf-96ea1656ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:14.611731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9762-9fdd-4114-8dbf-96ea1656ab98 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.612162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9762-9fdd-4114-8dbf-96ea1656ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.612556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9762-9fdd-4114-8dbf-96ea1656ab98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.622263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9762-9fdd-4114-8dbf-96ea1656ab98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:14.624246 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9762-9fdd-4114-8dbf-96ea1656ab98 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-aa1a9762-9fdd-4114-8dbf-96ea1656ab98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:14.639376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:14.640572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:14.641652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:14.641652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:14.641652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:14.641652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:14.641652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:14.641652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:14.641652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:14.641652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:14.641652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:14.641652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:14.648059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 312/627] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Jun 2 13:02:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:14.649084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9762-9fdd-4114-8dbf-96ea1656ab98 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:14.661839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825f628-fb21-40c6-9462-c80ff4660593 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:14.664624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:14.708284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4513ce9-7806-48ff-8fc5-0693ae6cc93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:14.709311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4513ce9-7806-48ff-8fc5-0693ae6cc93d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.709729 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4513ce9-7806-48ff-8fc5-0693ae6cc93d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.710166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4513ce9-7806-48ff-8fc5-0693ae6cc93d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.720995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4513ce9-7806-48ff-8fc5-0693ae6cc93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-e4513ce9-7806-48ff-8fc5-0693ae6cc93d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:14.729026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:14.730124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:14.731049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:14.736243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 316/628] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:14.737303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4513ce9-7806-48ff-8fc5-0693ae6cc93d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:14.781800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9762-9fdd-4114-8dbf-96ea1656ab98 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:14.819304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938f7ec-292b-4e50-8e79-3d0dc7955549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:14.820241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f7ec-292b-4e50-8e79-3d0dc7955549 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.820785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f7ec-292b-4e50-8e79-3d0dc7955549 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.821263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f7ec-292b-4e50-8e79-3d0dc7955549 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.822251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938f7ec-292b-4e50-8e79-3d0dc7955549 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:14.822762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938f7ec-292b-4e50-8e79-3d0dc7955549 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:14.824436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938f7ec-292b-4e50-8e79-3d0dc7955549 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:14.843583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 313/629] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:14.844923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938f7ec-292b-4e50-8e79-3d0dc7955549 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:14.849627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4513ce9-7806-48ff-8fc5-0693ae6cc93d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:14.875532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:14.886435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75424b84-f8e0-4777-b25e-682997b29a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:14.889472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75424b84-f8e0-4777-b25e-682997b29a51 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.889472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75424b84-f8e0-4777-b25e-682997b29a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.889472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75424b84-f8e0-4777-b25e-682997b29a51 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.889472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75424b84-f8e0-4777-b25e-682997b29a51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:14.889472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75424b84-f8e0-4777-b25e-682997b29a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:14.890448 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75424b84-f8e0-4777-b25e-682997b29a51 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:14.914754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 317/630] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Jun 2 13:02:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:14.915694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75424b84-f8e0-4777-b25e-682997b29a51 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:14.939581 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:14.953009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938f7ec-292b-4e50-8e79-3d0dc7955549 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:14.988392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d84f24-42aa-4188-b5a0-0b2632abdce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:14.989480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84f24-42aa-4188-b5a0-0b2632abdce9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:14.989970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84f24-42aa-4188-b5a0-0b2632abdce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:14.990718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d84f24-42aa-4188-b5a0-0b2632abdce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:14.991677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d84f24-42aa-4188-b5a0-0b2632abdce9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:14.992208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d84f24-42aa-4188-b5a0-0b2632abdce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:14.993795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d84f24-42aa-4188-b5a0-0b2632abdce9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:15.003247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 314/631] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:15.004499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d84f24-42aa-4188-b5a0-0b2632abdce9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:15.026715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75424b84-f8e0-4777-b25e-682997b29a51 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:15.070266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905df152-895d-49b0-85dc-a67a2ca3e3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:15.071163 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df152-895d-49b0-85dc-a67a2ca3e3c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:15.071443 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df152-895d-49b0-85dc-a67a2ca3e3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:15.071715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df152-895d-49b0-85dc-a67a2ca3e3c4 None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/bb4d690feb01473eaee368408c8a1dab/roles/268a1d65ee224ca3b6b59f003f936207` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:15.089366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905df152-895d-49b0-85dc-a67a2ca3e3c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=bb4d690feb01473eaee368408c8a1dab, role_id=268a1d65ee224ca3b6b59f003f936207)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:15.091384 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905df152-895d-49b0-85dc-a67a2ca3e3c4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:15.099582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:15.109250 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d84f24-42aa-4188-b5a0-0b2632abdce9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:15.152328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d44f-b8c2-4194-8649-cacbd624f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:15.153570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d44f-b8c2-4194-8649-cacbd624f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:15.153853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d44f-b8c2-4194-8649-cacbd624f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:15.154133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d44f-b8c2-4194-8649-cacbd624f4a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:15.188831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 318/632] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:02:14 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/bb4d690feb01473eaee368408c8a1dab/roles/268a1d65ee224ca3b6b59f003f936207 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:02:15.190529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9259d2-15bb-4cc9-acf6-92e5d479cef9 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:15.191053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9259d2-15bb-4cc9-acf6-92e5d479cef9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:15.191560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9259d2-15bb-4cc9-acf6-92e5d479cef9 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:15.193310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 319/633] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:15.194346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9259d2-15bb-4cc9-acf6-92e5d479cef9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:15.236080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4d44f-b8c2-4194-8649-cacbd624f4a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:15.237623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4d44f-b8c2-4194-8649-cacbd624f4a9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:15.324244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:15.364494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:15.369238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9259d2-15bb-4cc9-acf6-92e5d479cef9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:15.380375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 315/634] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:15.381814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820d47-4b77-4dca-92ef-3d1a9eaa2b8f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:15.382023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820d47-4b77-4dca-92ef-3d1a9eaa2b8f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:15.382291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820d47-4b77-4dca-92ef-3d1a9eaa2b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:15.410879 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-2a820d47-4b77-4dca-92ef-3d1a9eaa2b8f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:15.412259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2a820d47-4b77-4dca-92ef-3d1a9eaa2b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:15.422547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43e797-bfcd-4631-8f76-d557f10d1356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:15.423568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43e797-bfcd-4631-8f76-d557f10d1356 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:15.424064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43e797-bfcd-4631-8f76-d557f10d1356 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:15.424481 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43e797-bfcd-4631-8f76-d557f10d1356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:15.436249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43e797-bfcd-4631-8f76-d557f10d1356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:15.438548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43e797-bfcd-4631-8f76-d557f10d1356 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-de43e797-bfcd-4631-8f76-d557f10d1356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:15.461503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:15.462455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:15.463327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:15.463327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:15.463327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:15.463327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:15.463327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 320/635] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:15.463595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43e797-bfcd-4631-8f76-d557f10d1356 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:15.503497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 316/636] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:15.505132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820d47-4b77-4dca-92ef-3d1a9eaa2b8f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:15.613939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43e797-bfcd-4631-8f76-d557f10d1356 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:15.635816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820d47-4b77-4dca-92ef-3d1a9eaa2b8f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:15.639216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:15.651705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c7d64-3311-4460-8ef3-cbd5fba70fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:15.653378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c7d64-3311-4460-8ef3-cbd5fba70fdc None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:15.653835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c7d64-3311-4460-8ef3-cbd5fba70fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:15.654251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c7d64-3311-4460-8ef3-cbd5fba70fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:15.667413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c7d64-3311-4460-8ef3-cbd5fba70fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:15.669928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c7d64-3311-4460-8ef3-cbd5fba70fdc None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:15.674302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-e87c7d64-3311-4460-8ef3-cbd5fba70fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:15.691864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:15.693011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:15.694026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:15.694026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:15.694026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:15.694026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:15.701277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 321/637] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:15.701277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c7d64-3311-4460-8ef3-cbd5fba70fdc None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:15.703061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dd772-ce8f-43dd-9db0-063ec024d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:15.703771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dd772-ce8f-43dd-9db0-063ec024d644 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:15.704085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dd772-ce8f-43dd-9db0-063ec024d644 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:15.704361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dd772-ce8f-43dd-9db0-063ec024d644 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:15.705094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dd772-ce8f-43dd-9db0-063ec024d644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:15.705399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dd772-ce8f-43dd-9db0-063ec024d644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:15.707112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dd772-ce8f-43dd-9db0-063ec024d644 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:15.727000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 317/638] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:15.727355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dd772-ce8f-43dd-9db0-063ec024d644 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:15.833272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c7d64-3311-4460-8ef3-cbd5fba70fdc None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:15.847623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dd772-ce8f-43dd-9db0-063ec024d644 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:15.869366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b149d-b2e3-4ade-b538-bd62962a71e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:15.870533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b149d-b2e3-4ade-b538-bd62962a71e1 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:15.871112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b149d-b2e3-4ade-b538-bd62962a71e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:15.871629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b149d-b2e3-4ade-b538-bd62962a71e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:15.882804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b149d-b2e3-4ade-b538-bd62962a71e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:15.885266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484e1c3-a848-4b32-b036-967c839b2266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:15.885992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e1c3-a848-4b32-b036-967c839b2266 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:15.886221 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e1c3-a848-4b32-b036-967c839b2266 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:15.886496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e1c3-a848-4b32-b036-967c839b2266 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:15.887757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484e1c3-a848-4b32-b036-967c839b2266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:15.888098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484e1c3-a848-4b32-b036-967c839b2266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:15.889469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484e1c3-a848-4b32-b036-967c839b2266 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-ec3b149d-b2e3-4ade-b538-bd62962a71e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:15.893786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:15.894721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:15.895534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:15.899369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 322/639] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:15.900407 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b149d-b2e3-4ade-b538-bd62962a71e1 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:15.910616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 318/640] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:15.910616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484e1c3-a848-4b32-b036-967c839b2266 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:15.950996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:15.966225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:16.036479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b149d-b2e3-4ade-b538-bd62962a71e1 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:16.051595 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484e1c3-a848-4b32-b036-967c839b2266 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:16.074090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50f94e-e2a1-471b-bfb5-e155ae26bae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:16.075934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f94e-e2a1-471b-bfb5-e155ae26bae4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.076571 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f94e-e2a1-471b-bfb5-e155ae26bae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.076966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f94e-e2a1-471b-bfb5-e155ae26bae4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.085665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50f94e-e2a1-471b-bfb5-e155ae26bae4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:16.087345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50f94e-e2a1-471b-bfb5-e155ae26bae4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:16.088394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51c0b-19ca-487e-a0cb-2afef3e3efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:16.089069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51c0b-19ca-487e-a0cb-2afef3e3efb6 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.089355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51c0b-19ca-487e-a0cb-2afef3e3efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.089623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51c0b-19ca-487e-a0cb-2afef3e3efb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.090436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51c0b-19ca-487e-a0cb-2afef3e3efb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:16.090748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51c0b-19ca-487e-a0cb-2afef3e3efb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:16.092134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51c0b-19ca-487e-a0cb-2afef3e3efb6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:16.100281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 319/641] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:16.100281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51c0b-19ca-487e-a0cb-2afef3e3efb6 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-ff50f94e-e2a1-471b-bfb5-e155ae26bae4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:16.104992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:16.105927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 323/642] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b85101-0339-4a2b-8de3-240e1780b9bc None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.106866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b85101-0339-4a2b-8de3-240e1780b9bc None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.107579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b85101-0339-4a2b-8de3-240e1780b9bc None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.107579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 324/643] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:16.109529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b85101-0339-4a2b-8de3-240e1780b9bc None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:16.225216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51c0b-19ca-487e-a0cb-2afef3e3efb6 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:16.226913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:16.240088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:16.249370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b85101-0339-4a2b-8de3-240e1780b9bc None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:16.273643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660248-ffb3-4e28-af86-b56b66baf2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:16.274462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660248-ffb3-4e28-af86-b56b66baf2ac None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.274746 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660248-ffb3-4e28-af86-b56b66baf2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.275026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38660248-ffb3-4e28-af86-b56b66baf2ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.282629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38660248-ffb3-4e28-af86-b56b66baf2ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:16.284487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38660248-ffb3-4e28-af86-b56b66baf2ac None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:16.292520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f898b6-ead6-4c21-b5b4-248e4f3dbe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:16.293357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f898b6-ead6-4c21-b5b4-248e4f3dbe08 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.293638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f898b6-ead6-4c21-b5b4-248e4f3dbe08 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.293913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f898b6-ead6-4c21-b5b4-248e4f3dbe08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-38660248-ffb3-4e28-af86-b56b66baf2ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:16.300219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:16.301110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:16.302164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:16.302164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:16.302164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:16.302164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:16.302164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:16.302164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:16.302164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:16.302164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:16.302164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 320/644] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:16.302646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660248-ffb3-4e28-af86-b56b66baf2ac None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:16.310398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f898b6-ead6-4c21-b5b4-248e4f3dbe08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:16.311951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f898b6-ead6-4c21-b5b4-248e4f3dbe08 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-49f898b6-ead6-4c21-b5b4-248e4f3dbe08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:16.332034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:16.332974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:16.338803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:16.338803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:16.338803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:16.338803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:16.338803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 325/645] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:16.338803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456f52-92a1-426e-bae3-17b7ca745f9c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.338803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456f52-92a1-426e-bae3-17b7ca745f9c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.338803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456f52-92a1-426e-bae3-17b7ca745f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.354333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d1456f52-92a1-426e-bae3-17b7ca745f9c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:16.355596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d1456f52-92a1-426e-bae3-17b7ca745f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:16.448309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38660248-ffb3-4e28-af86-b56b66baf2ac None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:16.452822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 326/646] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:16.455558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1456f52-92a1-426e-bae3-17b7ca745f9c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:16.525765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15a9ab-875d-41de-8611-0778dd23bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:16.526756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a9ab-875d-41de-8611-0778dd23bd0e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.527223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a9ab-875d-41de-8611-0778dd23bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.527680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a9ab-875d-41de-8611-0778dd23bd0e None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.528767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15a9ab-875d-41de-8611-0778dd23bd0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:16.529270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15a9ab-875d-41de-8611-0778dd23bd0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:16.531062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15a9ab-875d-41de-8611-0778dd23bd0e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:16.559824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 321/647] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Jun 2 13:02:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:16.559824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15a9ab-875d-41de-8611-0778dd23bd0e None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:16.568552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:16.581601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:16.596523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1456f52-92a1-426e-bae3-17b7ca745f9c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:16.643237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec7a26-4f10-434b-83ce-9d902ce2b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:16.643917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec7a26-4f10-434b-83ce-9d902ce2b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.644212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec7a26-4f10-434b-83ce-9d902ce2b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.644493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec7a26-4f10-434b-83ce-9d902ce2b1f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.645288 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec7a26-4f10-434b-83ce-9d902ce2b1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:16.645600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec7a26-4f10-434b-83ce-9d902ce2b1f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:16.647045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec7a26-4f10-434b-83ce-9d902ce2b1f0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:16.664419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 327/648] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:16.664589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15a9ab-875d-41de-8611-0778dd23bd0e None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:16.664684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec7a26-4f10-434b-83ce-9d902ce2b1f0 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:16.701559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd742a-5783-404b-9255-2542b6ffba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:16.702230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd742a-5783-404b-9255-2542b6ffba64 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.702516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd742a-5783-404b-9255-2542b6ffba64 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.702803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd742a-5783-404b-9255-2542b6ffba64 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.703519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd742a-5783-404b-9255-2542b6ffba64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:16.703828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd742a-5783-404b-9255-2542b6ffba64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:16.705394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd742a-5783-404b-9255-2542b6ffba64 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:16.723272 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 322/649] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:16.723272 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd742a-5783-404b-9255-2542b6ffba64 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:16.785920 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec7a26-4f10-434b-83ce-9d902ce2b1f0 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:16.830411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:16.833679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0477aec-7762-4658-8383-86a6e4111ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:16.834507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0477aec-7762-4658-8383-86a6e4111ccc None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.834795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0477aec-7762-4658-8383-86a6e4111ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.835068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0477aec-7762-4658-8383-86a6e4111ccc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.838247 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:16.850198 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0477aec-7762-4658-8383-86a6e4111ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:16.850613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd742a-5783-404b-9255-2542b6ffba64 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-e0477aec-7762-4658-8383-86a6e4111ccc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:16.863790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:16.865933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 328/650] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:16.867429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0477aec-7762-4658-8383-86a6e4111ccc None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:16.896688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dddd63-5169-4ad2-b947-7664d0456a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:16.897396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dddd63-5169-4ad2-b947-7664d0456a13 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:16.897683 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dddd63-5169-4ad2-b947-7664d0456a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:16.897958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dddd63-5169-4ad2-b947-7664d0456a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:16.973450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dddd63-5169-4ad2-b947-7664d0456a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:16.975250 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dddd63-5169-4ad2-b947-7664d0456a13 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:16.985493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0477aec-7762-4658-8383-86a6e4111ccc None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:17.022818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd0a2a-80cf-4f63-bbd6-9fd8c312a09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:17.023518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd0a2a-80cf-4f63-bbd6-9fd8c312a09a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:17.023800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd0a2a-80cf-4f63-bbd6-9fd8c312a09a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:17.024103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd0a2a-80cf-4f63-bbd6-9fd8c312a09a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:17.024946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd0a2a-80cf-4f63-bbd6-9fd8c312a09a None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=ae1c6084061f4434864e9f7bcc553733) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:17.025259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd0a2a-80cf-4f63-bbd6-9fd8c312a09a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:17.026911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd0a2a-80cf-4f63-bbd6-9fd8c312a09a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:17.033104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 329/651] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:16 2022] GET /identity/v3/role_assignments?user.id=ae1c6084061f4434864e9f7bcc553733&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:17.033897 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd0a2a-80cf-4f63-bbd6-9fd8c312a09a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:17.091727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:17.113770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 323/652] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:17.115110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dddd63-5169-4ad2-b947-7664d0456a13 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:17.131169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:17.178688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd0a2a-80cf-4f63-bbd6-9fd8c312a09a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:17.220694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bd095-365c-407f-a2b5-27bcd9c313a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:17.221562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bd095-365c-407f-a2b5-27bcd9c313a0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:17.221850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bd095-365c-407f-a2b5-27bcd9c313a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:17.222125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bd095-365c-407f-a2b5-27bcd9c313a0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:17.231334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bd095-365c-407f-a2b5-27bcd9c313a0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:17.232559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bd095-365c-407f-a2b5-27bcd9c313a0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:17.238171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dddd63-5169-4ad2-b947-7664d0456a13 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-953bd095-365c-407f-a2b5-27bcd9c313a0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:17.249657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:17.250696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 330/653] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:17.252303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bd095-365c-407f-a2b5-27bcd9c313a0 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:17.287074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49d47e-63ee-4b0c-82b4-353a3a8ce338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:17.288795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49d47e-63ee-4b0c-82b4-353a3a8ce338 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:17.289327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49d47e-63ee-4b0c-82b4-353a3a8ce338 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:17.289965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49d47e-63ee-4b0c-82b4-353a3a8ce338 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:17.291521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49d47e-63ee-4b0c-82b4-353a3a8ce338 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:17.292082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49d47e-63ee-4b0c-82b4-353a3a8ce338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:17.294425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49d47e-63ee-4b0c-82b4-353a3a8ce338 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:17.305795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 324/654] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:17.307015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49d47e-63ee-4b0c-82b4-353a3a8ce338 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:17.362439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:17.396228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bd095-365c-407f-a2b5-27bcd9c313a0 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:17.427900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:17.444691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49d47e-63ee-4b0c-82b4-353a3a8ce338 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:17.444827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736496e-0de3-4230-927d-3a49ccb38108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:17.444827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736496e-0de3-4230-927d-3a49ccb38108 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:17.444827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736496e-0de3-4230-927d-3a49ccb38108 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:17.444827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736496e-0de3-4230-927d-3a49ccb38108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:17.459215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736496e-0de3-4230-927d-3a49ccb38108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:17.461306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736496e-0de3-4230-927d-3a49ccb38108 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:17.472878 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb8450-91cd-426f-8144-802784d0b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:17.473559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb8450-91cd-426f-8144-802784d0b148 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:17.473842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb8450-91cd-426f-8144-802784d0b148 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:17.474119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb8450-91cd-426f-8144-802784d0b148 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:17.474965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb8450-91cd-426f-8144-802784d0b148 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:17.475276 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb8450-91cd-426f-8144-802784d0b148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:17.476731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb8450-91cd-426f-8144-802784d0b148 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-9736496e-0de3-4230-927d-3a49ccb38108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:17.487084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:17.488054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:17.489876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:17.489876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:17.489876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:17.489876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:17.489876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 331/655] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:17.489876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736496e-0de3-4230-927d-3a49ccb38108 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:17.501976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 325/656] 10.222.0.46 () {56 vars in 1137 bytes} [Thu Jun 2 13:02:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:17.502834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb8450-91cd-426f-8144-802784d0b148 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:17.624842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:17.627955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb8450-91cd-426f-8144-802784d0b148 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:17.633752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736496e-0de3-4230-927d-3a49ccb38108 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:17.664633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8414a0-4fd3-4ea7-ace7-2d86572555cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:17.665296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8414a0-4fd3-4ea7-ace7-2d86572555cd None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:17.665577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8414a0-4fd3-4ea7-ace7-2d86572555cd None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:17.665851 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8414a0-4fd3-4ea7-ace7-2d86572555cd None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:17.666571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8414a0-4fd3-4ea7-ace7-2d86572555cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:17.666874 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8414a0-4fd3-4ea7-ace7-2d86572555cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:17.668823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8414a0-4fd3-4ea7-ace7-2d86572555cd None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:17.670264 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5168a-966e-457c-9a84-bfb9e949a4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:17.671374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5168a-966e-457c-9a84-bfb9e949a4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:17.671482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5168a-966e-457c-9a84-bfb9e949a4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:17.671742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5168a-966e-457c-9a84-bfb9e949a4b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:17.684323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 326/657] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:17.684323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8414a0-4fd3-4ea7-ace7-2d86572555cd None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:17.687246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5168a-966e-457c-9a84-bfb9e949a4b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:17.688753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5168a-966e-457c-9a84-bfb9e949a4b7 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-26b5168a-966e-457c-9a84-bfb9e949a4b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:17.707048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:17.708271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:17.709164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:17.709164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:17.709164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:17.709164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:17.709164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 332/658] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:17.709715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efcba5-fa60-44b5-81aa-366419c42399 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:17.709811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efcba5-fa60-44b5-81aa-366419c42399 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:17.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efcba5-fa60-44b5-81aa-366419c42399 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:17.715727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 333/659] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:17.715727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efcba5-fa60-44b5-81aa-366419c42399 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:17.743502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:17.797612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8414a0-4fd3-4ea7-ace7-2d86572555cd None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:17.822159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efcba5-fa60-44b5-81aa-366419c42399 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:17.830295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61778b9b-471e-4af6-b40a-ab0d56c8e072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:17.830948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61778b9b-471e-4af6-b40a-ab0d56c8e072 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:17.831229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61778b9b-471e-4af6-b40a-ab0d56c8e072 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:17.831505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61778b9b-471e-4af6-b40a-ab0d56c8e072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:17.857230 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b4583-9677-457c-ab7f-284514550966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:17.858019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b4583-9677-457c-ab7f-284514550966 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:17.858300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b4583-9677-457c-ab7f-284514550966 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:17.858572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b4583-9677-457c-ab7f-284514550966 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:17.859763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:17.865553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b4583-9677-457c-ab7f-284514550966 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:17.867098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b4583-9677-457c-ab7f-284514550966 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-8f5b4583-9677-457c-ab7f-284514550966 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:17.881239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:17.882347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:17.883248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:17.883248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:17.883248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:17.883248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:17.883248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:17.883248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:17.883248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:17.883248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:17.883248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 334/660] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:17.883248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b4583-9677-457c-ab7f-284514550966 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:17.907861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61778b9b-471e-4af6-b40a-ab0d56c8e072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:17.909348 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61778b9b-471e-4af6-b40a-ab0d56c8e072 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:17.975289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:17.992229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b4583-9677-457c-ab7f-284514550966 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:18.013114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 327/661] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:18.014523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874dab1-684d-430a-aa00-8c7b3a5269f6 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:18.014813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874dab1-684d-430a-aa00-8c7b3a5269f6 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:18.015085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874dab1-684d-430a-aa00-8c7b3a5269f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:18.032110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-2874dab1-684d-430a-aa00-8c7b3a5269f6 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:18.033258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2874dab1-684d-430a-aa00-8c7b3a5269f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:18.034898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0a067-2254-4f53-bb7f-d1b2d5005c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:18.035724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0a067-2254-4f53-bb7f-d1b2d5005c97 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:18.036809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0a067-2254-4f53-bb7f-d1b2d5005c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:18.037093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0a067-2254-4f53-bb7f-d1b2d5005c97 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:18.037821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0a067-2254-4f53-bb7f-d1b2d5005c97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:18.038129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0a067-2254-4f53-bb7f-d1b2d5005c97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:18.039500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0a067-2254-4f53-bb7f-d1b2d5005c97 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:18.057284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 335/662] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:18.058180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0a067-2254-4f53-bb7f-d1b2d5005c97 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:18.096145 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:18.107401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 328/663] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:18.108261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874dab1-684d-430a-aa00-8c7b3a5269f6 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:18.175067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0a067-2254-4f53-bb7f-d1b2d5005c97 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:18.211923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073aac59-8ece-4e3a-b6e2-7f12552c3f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:18.212590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073aac59-8ece-4e3a-b6e2-7f12552c3f51 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:18.212696 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874dab1-684d-430a-aa00-8c7b3a5269f6 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:18.212888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073aac59-8ece-4e3a-b6e2-7f12552c3f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:18.213144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073aac59-8ece-4e3a-b6e2-7f12552c3f51 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:18.214234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073aac59-8ece-4e3a-b6e2-7f12552c3f51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:18.214666 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073aac59-8ece-4e3a-b6e2-7f12552c3f51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:18.217307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073aac59-8ece-4e3a-b6e2-7f12552c3f51 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:18.236539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 336/664] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:18.236539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073aac59-8ece-4e3a-b6e2-7f12552c3f51 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:18.242114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:18.249328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8338327-406b-4047-b376-494e8e8455e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:18.250128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8338327-406b-4047-b376-494e8e8455e9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:18.250415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8338327-406b-4047-b376-494e8e8455e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:18.256684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8338327-406b-4047-b376-494e8e8455e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:18.261308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8338327-406b-4047-b376-494e8e8455e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:18.263292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8338327-406b-4047-b376-494e8e8455e9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-a8338327-406b-4047-b376-494e8e8455e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:18.281866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:18.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:18.283970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:18.283970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:18.283970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:18.283970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:18.283970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 329/665] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:18.283970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8338327-406b-4047-b376-494e8e8455e9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:18.332543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:18.356148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073aac59-8ece-4e3a-b6e2-7f12552c3f51 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:18.393545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8338327-406b-4047-b376-494e8e8455e9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:18.398780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fbaa7-34ae-4db7-8268-d203accf0bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:18.399596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fbaa7-34ae-4db7-8268-d203accf0bfc None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:18.399915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fbaa7-34ae-4db7-8268-d203accf0bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:18.400187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fbaa7-34ae-4db7-8268-d203accf0bfc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:18.409276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fbaa7-34ae-4db7-8268-d203accf0bfc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:18.410719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fbaa7-34ae-4db7-8268-d203accf0bfc None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-984fbaa7-34ae-4db7-8268-d203accf0bfc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:18.425898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:18.427060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 337/666] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:18.428326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fbaa7-34ae-4db7-8268-d203accf0bfc None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:18.436313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462fcee-0beb-47da-8f82-814334003dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:18.437116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fcee-0beb-47da-8f82-814334003dad None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:18.437394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fcee-0beb-47da-8f82-814334003dad None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:18.437668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fcee-0beb-47da-8f82-814334003dad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:18.449229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462fcee-0beb-47da-8f82-814334003dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-c462fcee-0beb-47da-8f82-814334003dad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:18.457266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:18.458243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 330/667] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:18.459065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462fcee-0beb-47da-8f82-814334003dad None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:18.504649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:18.546274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fbaa7-34ae-4db7-8268-d203accf0bfc None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:18.567675 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462fcee-0beb-47da-8f82-814334003dad None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:18.570094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:18.580989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91345-0715-4dad-817b-1fdd13ed22f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:18.581654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91345-0715-4dad-817b-1fdd13ed22f6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:18.581941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91345-0715-4dad-817b-1fdd13ed22f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:18.582219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91345-0715-4dad-817b-1fdd13ed22f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:18.583059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91345-0715-4dad-817b-1fdd13ed22f6 None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=979519f42f7d463bb2ee1d5b0bb72a45) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:18.588237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91345-0715-4dad-817b-1fdd13ed22f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:18.588237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91345-0715-4dad-817b-1fdd13ed22f6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:18.591169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 338/668] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:18 2022] GET /identity/v3/role_assignments?user.id=979519f42f7d463bb2ee1d5b0bb72a45&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:18.591993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91345-0715-4dad-817b-1fdd13ed22f6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:18.618304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e61e4-b44d-4ad6-a36a-3f20203eb7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:18.619612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e61e4-b44d-4ad6-a36a-3f20203eb7df None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:18.619954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e61e4-b44d-4ad6-a36a-3f20203eb7df None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:18.620199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e61e4-b44d-4ad6-a36a-3f20203eb7df None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:18.620964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e61e4-b44d-4ad6-a36a-3f20203eb7df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:18.621312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e61e4-b44d-4ad6-a36a-3f20203eb7df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:18.622760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e61e4-b44d-4ad6-a36a-3f20203eb7df None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:18.642203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 331/669] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:18.644201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e61e4-b44d-4ad6-a36a-3f20203eb7df None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:18.749149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91345-0715-4dad-817b-1fdd13ed22f6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:18.787447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e61e4-b44d-4ad6-a36a-3f20203eb7df None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:18.793915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:18.804634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b43e4-f811-4407-9f20-9fb5a415852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:18.805719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b43e4-f811-4407-9f20-9fb5a415852e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:18.806008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b43e4-f811-4407-9f20-9fb5a415852e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:18.806285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b43e4-f811-4407-9f20-9fb5a415852e None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:18.811302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b43e4-f811-4407-9f20-9fb5a415852e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:18.811302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b43e4-f811-4407-9f20-9fb5a415852e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:18.811302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b43e4-f811-4407-9f20-9fb5a415852e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:18.830409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 339/670] 10.222.0.46 () {56 vars in 1139 bytes} [Thu Jun 2 13:02:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:18.831117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b43e4-f811-4407-9f20-9fb5a415852e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:18.835167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83882b46-ec60-4ea4-b975-0586d176dea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:18.835855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83882b46-ec60-4ea4-b975-0586d176dea5 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:18.836167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83882b46-ec60-4ea4-b975-0586d176dea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:18.837150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83882b46-ec60-4ea4-b975-0586d176dea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:18.837255 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83882b46-ec60-4ea4-b975-0586d176dea5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:18.837495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83882b46-ec60-4ea4-b975-0586d176dea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:18.839709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83882b46-ec60-4ea4-b975-0586d176dea5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:18.853388 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 332/671] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:18.854319 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83882b46-ec60-4ea4-b975-0586d176dea5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:18.887505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:18.971318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b43e4-f811-4407-9f20-9fb5a415852e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:18.982969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83882b46-ec60-4ea4-b975-0586d176dea5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:19.016302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96798637-ea94-4c96-af51-d3ae8aacb14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:19.017282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96798637-ea94-4c96-af51-d3ae8aacb14d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.017655 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96798637-ea94-4c96-af51-d3ae8aacb14d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.018019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96798637-ea94-4c96-af51-d3ae8aacb14d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.020450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de707f58-1fd6-41e4-a746-1ece5c075a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:19.021217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de707f58-1fd6-41e4-a746-1ece5c075a43 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.021498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de707f58-1fd6-41e4-a746-1ece5c075a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.021771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de707f58-1fd6-41e4-a746-1ece5c075a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.026388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96798637-ea94-4c96-af51-d3ae8aacb14d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:19.028507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96798637-ea94-4c96-af51-d3ae8aacb14d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-96798637-ea94-4c96-af51-d3ae8aacb14d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:19.046816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:19.047767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:19.048770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:19.048770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:19.048770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:19.048770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:19.048770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:19.048770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:19.048770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:19.048770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:19.051973 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 340/672] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:19.052860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96798637-ea94-4c96-af51-d3ae8aacb14d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:19.100716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de707f58-1fd6-41e4-a746-1ece5c075a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:19.102167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de707f58-1fd6-41e4-a746-1ece5c075a43 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:19.112867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:19.130038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:19.194398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96798637-ea94-4c96-af51-d3ae8aacb14d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:19.222612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 333/673] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:19.223610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de707f58-1fd6-41e4-a746-1ece5c075a43 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:19.237628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4212574-32b6-4bed-a9a8-8c46113e0566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:19.238556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4212574-32b6-4bed-a9a8-8c46113e0566 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.238910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4212574-32b6-4bed-a9a8-8c46113e0566 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.239255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4212574-32b6-4bed-a9a8-8c46113e0566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.251485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4212574-32b6-4bed-a9a8-8c46113e0566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:19.253082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4212574-32b6-4bed-a9a8-8c46113e0566 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-b4212574-32b6-4bed-a9a8-8c46113e0566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:19.271478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:19.272427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:19.273310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:19.273310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:19.273310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:19.273310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:19.273310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 341/674] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:19.274211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4212574-32b6-4bed-a9a8-8c46113e0566 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:19.338700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de707f58-1fd6-41e4-a746-1ece5c075a43 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:19.372379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:19.377328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:19.381162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcdc85-f73c-46f5-8dc3-cb963c010cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:19.382023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcdc85-f73c-46f5-8dc3-cb963c010cec None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.382480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcdc85-f73c-46f5-8dc3-cb963c010cec None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.382899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcdc85-f73c-46f5-8dc3-cb963c010cec None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.384245 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcdc85-f73c-46f5-8dc3-cb963c010cec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:19.384706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcdc85-f73c-46f5-8dc3-cb963c010cec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:19.386568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcdc85-f73c-46f5-8dc3-cb963c010cec None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:19.387896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4212574-32b6-4bed-a9a8-8c46113e0566 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:19.404287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 334/675] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:19.405530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcdc85-f73c-46f5-8dc3-cb963c010cec None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:19.432981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa76db-2c4c-4979-be18-7259c4221b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:19.434866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa76db-2c4c-4979-be18-7259c4221b4e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.435354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa76db-2c4c-4979-be18-7259c4221b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.435832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa76db-2c4c-4979-be18-7259c4221b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.447778 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa76db-2c4c-4979-be18-7259c4221b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:19.450205 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa76db-2c4c-4979-be18-7259c4221b4e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-1efa76db-2c4c-4979-be18-7259c4221b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:19.470445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:19.471396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:19.472668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:19.472668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:19.472668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:19.472668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:19.474742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 342/676] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:19.475926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa76db-2c4c-4979-be18-7259c4221b4e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:19.532053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcdc85-f73c-46f5-8dc3-cb963c010cec None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:19.574262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b254a-823e-4f4a-bf29-f71d68591951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:19.575227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b254a-823e-4f4a-bf29-f71d68591951 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.575512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b254a-823e-4f4a-bf29-f71d68591951 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.576073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b254a-823e-4f4a-bf29-f71d68591951 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.577269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b254a-823e-4f4a-bf29-f71d68591951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:19.577588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b254a-823e-4f4a-bf29-f71d68591951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:19.579536 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b254a-823e-4f4a-bf29-f71d68591951 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:19.586541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa76db-2c4c-4979-be18-7259c4221b4e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:19.596500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 335/677] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:19.596500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b254a-823e-4f4a-bf29-f71d68591951 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:19.629323 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd06eab-af40-49ba-993c-47cf73e80c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:19.629985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd06eab-af40-49ba-993c-47cf73e80c42 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.630270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd06eab-af40-49ba-993c-47cf73e80c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.630546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd06eab-af40-49ba-993c-47cf73e80c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.631387 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd06eab-af40-49ba-993c-47cf73e80c42 None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=c2bc11c0ef524d7ea5cb8704fbbfcbb2) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:19.631710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd06eab-af40-49ba-993c-47cf73e80c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:19.633190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd06eab-af40-49ba-993c-47cf73e80c42 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:19.639506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 343/678] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:19 2022] GET /identity/v3/role_assignments?user.id=c2bc11c0ef524d7ea5cb8704fbbfcbb2&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:19.640906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faac355-2e4e-40e2-9405-843dabf65950 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.641191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faac355-2e4e-40e2-9405-843dabf65950 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.641465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faac355-2e4e-40e2-9405-843dabf65950 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.642977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 344/679] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:19.643517 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faac355-2e4e-40e2-9405-843dabf65950 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:19.654515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:19.670702 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:19.721089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b254a-823e-4f4a-bf29-f71d68591951 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:19.776705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaab85-cf3c-47a7-a9b0-7f4ccca35e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:19.777544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaab85-cf3c-47a7-a9b0-7f4ccca35e46 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.777827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaab85-cf3c-47a7-a9b0-7f4ccca35e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.778374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaab85-cf3c-47a7-a9b0-7f4ccca35e46 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.779630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaab85-cf3c-47a7-a9b0-7f4ccca35e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:19.780099 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaab85-cf3c-47a7-a9b0-7f4ccca35e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:19.781891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaab85-cf3c-47a7-a9b0-7f4ccca35e46 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:19.787117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faac355-2e4e-40e2-9405-843dabf65950 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:19.798850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 336/680] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:19.800787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132058c-d15c-40fc-8a79-63f6e816df39 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.801365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132058c-d15c-40fc-8a79-63f6e816df39 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.801647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132058c-d15c-40fc-8a79-63f6e816df39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.822860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-6132058c-d15c-40fc-8a79-63f6e816df39 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:19.824135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6132058c-d15c-40fc-8a79-63f6e816df39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:19.835614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cecc6-08c8-47e4-a3fa-9129d31c527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:19.836480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cecc6-08c8-47e4-a3fa-9129d31c527d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:19.836763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cecc6-08c8-47e4-a3fa-9129d31c527d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:19.837241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cecc6-08c8-47e4-a3fa-9129d31c527d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:19.846545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cecc6-08c8-47e4-a3fa-9129d31c527d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:19.848078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cecc6-08c8-47e4-a3fa-9129d31c527d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-3f8cecc6-08c8-47e4-a3fa-9129d31c527d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:19.865888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:19.866883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:19.867812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 345/681] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:19.869323 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cecc6-08c8-47e4-a3fa-9129d31c527d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:19.921723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 337/682] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:19.922924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132058c-d15c-40fc-8a79-63f6e816df39 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:19.962557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:19.978459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:19.991609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cecc6-08c8-47e4-a3fa-9129d31c527d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:20.030413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10f73e-df1e-423e-a1b9-1d0ad37b6cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:20.031613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10f73e-df1e-423e-a1b9-1d0ad37b6cec None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:20.032157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10f73e-df1e-423e-a1b9-1d0ad37b6cec None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:20.032614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10f73e-df1e-423e-a1b9-1d0ad37b6cec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:20.040216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10f73e-df1e-423e-a1b9-1d0ad37b6cec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:20.042015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10f73e-df1e-423e-a1b9-1d0ad37b6cec None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:20.056922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132058c-d15c-40fc-8a79-63f6e816df39 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-3b10f73e-df1e-423e-a1b9-1d0ad37b6cec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:20.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:20.059060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:20.059960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:20.059960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:20.059960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:20.059960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:20.059960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:20.059960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:20.059960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:20.059960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:20.062432 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 346/683] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:20.063586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10f73e-df1e-423e-a1b9-1d0ad37b6cec None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:20.099077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987f390-2c70-43de-8dfa-d621be9fb80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:20.100167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987f390-2c70-43de-8dfa-d621be9fb80d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:20.100648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987f390-2c70-43de-8dfa-d621be9fb80d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:20.101070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987f390-2c70-43de-8dfa-d621be9fb80d None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:20.102078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987f390-2c70-43de-8dfa-d621be9fb80d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:20.102655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987f390-2c70-43de-8dfa-d621be9fb80d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:20.104396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987f390-2c70-43de-8dfa-d621be9fb80d None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:20.126509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 338/684] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Jun 2 13:02:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:20.127842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987f390-2c70-43de-8dfa-d621be9fb80d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:20.189088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10f73e-df1e-423e-a1b9-1d0ad37b6cec None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:20.228529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8a704-3d00-4295-8191-d0f8069b1ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:20.229671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8a704-3d00-4295-8191-d0f8069b1ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:20.230233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8a704-3d00-4295-8191-d0f8069b1ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:20.230848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8a704-3d00-4295-8191-d0f8069b1ce8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:20.233027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:20.237936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:20.244302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8a704-3d00-4295-8191-d0f8069b1ce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:20.247460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987f390-2c70-43de-8dfa-d621be9fb80d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-e3e8a704-3d00-4295-8191-d0f8069b1ce8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:20.252873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:20.253884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:20.254786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:20.262528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 347/685] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:20.263647 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8a704-3d00-4295-8191-d0f8069b1ce8 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:20.291651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac8ca-7cee-4b53-9eb8-264aa5088f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:20.292279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac8ca-7cee-4b53-9eb8-264aa5088f78 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:20.292567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac8ca-7cee-4b53-9eb8-264aa5088f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:20.292847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac8ca-7cee-4b53-9eb8-264aa5088f78 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:20.293692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aac8ca-7cee-4b53-9eb8-264aa5088f78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:20.293977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aac8ca-7cee-4b53-9eb8-264aa5088f78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:20.295426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aac8ca-7cee-4b53-9eb8-264aa5088f78 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:20.307532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 339/686] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:20.308513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac8ca-7cee-4b53-9eb8-264aa5088f78 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:20.374454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8a704-3d00-4295-8191-d0f8069b1ce8 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:20.410771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cd390-a913-4415-a7db-3e70754baff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:20.411667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cd390-a913-4415-a7db-3e70754baff9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:20.412224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cd390-a913-4415-a7db-3e70754baff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:20.412655 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cd390-a913-4415-a7db-3e70754baff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:20.415730 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac8ca-7cee-4b53-9eb8-264aa5088f78 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:20.452906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7496f34-1634-4659-a17b-0fe42dada282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:20.453585 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7496f34-1634-4659-a17b-0fe42dada282 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:20.453871 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7496f34-1634-4659-a17b-0fe42dada282 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:20.454201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7496f34-1634-4659-a17b-0fe42dada282 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:20.454956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7496f34-1634-4659-a17b-0fe42dada282 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:20.455330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7496f34-1634-4659-a17b-0fe42dada282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:20.456903 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7496f34-1634-4659-a17b-0fe42dada282 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:20.467098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 340/687] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:20.468067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7496f34-1634-4659-a17b-0fe42dada282 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:20.479588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:20.486545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:20.489404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cd390-a913-4415-a7db-3e70754baff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:20.491365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cd390-a913-4415-a7db-3e70754baff9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:20.580335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7496f34-1634-4659-a17b-0fe42dada282 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:20.600294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 348/688] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:20.601710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cd390-a913-4415-a7db-3e70754baff9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:20.622844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f57b4-5b36-448a-9b35-e6718a0ca48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:20.623680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f57b4-5b36-448a-9b35-e6718a0ca48c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:20.623954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f57b4-5b36-448a-9b35-e6718a0ca48c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:20.624233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f57b4-5b36-448a-9b35-e6718a0ca48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:20.625073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f57b4-5b36-448a-9b35-e6718a0ca48c None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=ae7551e9626541d49a1be9330094f42e) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:20.625443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f57b4-5b36-448a-9b35-e6718a0ca48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:20.626891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f57b4-5b36-448a-9b35-e6718a0ca48c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:20.633824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 341/689] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:20 2022] GET /identity/v3/role_assignments?user.id=ae7551e9626541d49a1be9330094f42e&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:20.634855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f57b4-5b36-448a-9b35-e6718a0ca48c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:20.709780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:20.717939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cd390-a913-4415-a7db-3e70754baff9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:20.725006 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:20.748138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f57b4-5b36-448a-9b35-e6718a0ca48c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:20.757328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4a18-4c2c-42c3-a449-f728766067b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:20.758447 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4a18-4c2c-42c3-a449-f728766067b1 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:20.758872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4a18-4c2c-42c3-a449-f728766067b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:20.759286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4a18-4c2c-42c3-a449-f728766067b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:20.771028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e4a18-4c2c-42c3-a449-f728766067b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:20.772795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e4a18-4c2c-42c3-a449-f728766067b1 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:20.784688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59385781-8578-4679-9b1b-eab54985bdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:20.785498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385781-8578-4679-9b1b-eab54985bdec None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:20.785791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385781-8578-4679-9b1b-eab54985bdec None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:20.786076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385781-8578-4679-9b1b-eab54985bdec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-7d7e4a18-4c2c-42c3-a449-f728766067b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:20.796075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:20.797186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:20.798268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:20.798268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:20.798268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:20.798268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:20.800319 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 349/690] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:20.801731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59385781-8578-4679-9b1b-eab54985bdec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:20.803296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59385781-8578-4679-9b1b-eab54985bdec None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:20.808999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4a18-4c2c-42c3-a449-f728766067b1 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-59385781-8578-4679-9b1b-eab54985bdec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:20.837663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:20.838890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:20.840596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:20.840596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:20.840596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:20.840596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:20.842934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 342/691] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:20.850473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59385781-8578-4679-9b1b-eab54985bdec None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:20.984938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4a18-4c2c-42c3-a449-f728766067b1 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:21.003796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59385781-8578-4679-9b1b-eab54985bdec None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:21.025723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194b11-226b-4fa3-9939-0e4784de022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:21.026690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194b11-226b-4fa3-9939-0e4784de022f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.027147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194b11-226b-4fa3-9939-0e4784de022f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.028172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194b11-226b-4fa3-9939-0e4784de022f None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.029192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc194b11-226b-4fa3-9939-0e4784de022f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:21.029794 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc194b11-226b-4fa3-9939-0e4784de022f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:21.031424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc194b11-226b-4fa3-9939-0e4784de022f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:21.035438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:21.047112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9ce77-c9af-462c-a36c-cb88db873158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:21.050518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9ce77-c9af-462c-a36c-cb88db873158 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.050518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9ce77-c9af-462c-a36c-cb88db873158 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.050518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9ce77-c9af-462c-a36c-cb88db873158 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.050518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9ce77-c9af-462c-a36c-cb88db873158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:21.050518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9ce77-c9af-462c-a36c-cb88db873158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:21.050863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 350/692] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:21.050947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9ce77-c9af-462c-a36c-cb88db873158 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:21.055031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194b11-226b-4fa3-9939-0e4784de022f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:21.064546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:21.071715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 343/693] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:21.072954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9ce77-c9af-462c-a36c-cb88db873158 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:21.166654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194b11-226b-4fa3-9939-0e4784de022f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:21.186280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9ce77-c9af-462c-a36c-cb88db873158 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:21.212582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5229dc-8dcf-415b-8314-c4e6cef3f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:21.213394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5229dc-8dcf-415b-8314-c4e6cef3f57a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.213713 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5229dc-8dcf-415b-8314-c4e6cef3f57a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.214216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5229dc-8dcf-415b-8314-c4e6cef3f57a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.223843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5229dc-8dcf-415b-8314-c4e6cef3f57a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:21.225742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5229dc-8dcf-415b-8314-c4e6cef3f57a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:21.230321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a7b62-5c3d-4dc4-805b-b88c98c8c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:21.231168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7b62-5c3d-4dc4-805b-b88c98c8c23e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.231454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7b62-5c3d-4dc4-805b-b88c98c8c23e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.231732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7b62-5c3d-4dc4-805b-b88c98c8c23e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.238722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a7b62-5c3d-4dc4-805b-b88c98c8c23e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:21.240480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a7b62-5c3d-4dc4-805b-b88c98c8c23e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-1b5229dc-8dcf-415b-8314-c4e6cef3f57a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:21.240741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:21.241625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:21.242544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 351/694] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Jun 2 13:02:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:21.243683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789eeac-18d4-4dcc-9414-0fa867e5a067 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.243683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789eeac-18d4-4dcc-9414-0fa867e5a067 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.243837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789eeac-18d4-4dcc-9414-0fa867e5a067 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.245141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 352/695] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:21.250232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789eeac-18d4-4dcc-9414-0fa867e5a067 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-291a7b62-5c3d-4dc4-805b-b88c98c8c23e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:21.260524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:21.261426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:21.262854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:21.262854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:21.262854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:21.262854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:21.262854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:21.262854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:21.262854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:21.262854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:21.262854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 344/696] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:21.263801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75713a-e318-4cf7-b6fb-a38c5e6789b3 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.268281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75713a-e318-4cf7-b6fb-a38c5e6789b3 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.268587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75713a-e318-4cf7-b6fb-a38c5e6789b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.288159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9b75713a-e318-4cf7-b6fb-a38c5e6789b3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:21.289349 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9b75713a-e318-4cf7-b6fb-a38c5e6789b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:21.330157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:21.350828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:21.365691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789eeac-18d4-4dcc-9414-0fa867e5a067 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:21.378035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 345/697] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:21.378964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75713a-e318-4cf7-b6fb-a38c5e6789b3 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:21.433257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8147-7f60-4f20-b617-9ff41a391116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:21.434394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8147-7f60-4f20-b617-9ff41a391116 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.434682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8147-7f60-4f20-b617-9ff41a391116 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.434953 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8147-7f60-4f20-b617-9ff41a391116 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.435798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be8147-7f60-4f20-b617-9ff41a391116 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:21.436132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be8147-7f60-4f20-b617-9ff41a391116 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:21.437575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be8147-7f60-4f20-b617-9ff41a391116 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:21.456478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 353/698] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Jun 2 13:02:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:21.457384 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8147-7f60-4f20-b617-9ff41a391116 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:21.492935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75713a-e318-4cf7-b6fb-a38c5e6789b3 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:21.530653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f418dc-11fe-4f50-a51f-5d7a48846ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:21.531620 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f418dc-11fe-4f50-a51f-5d7a48846ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.532010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f418dc-11fe-4f50-a51f-5d7a48846ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.532289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f418dc-11fe-4f50-a51f-5d7a48846ad4 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.533336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f418dc-11fe-4f50-a51f-5d7a48846ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:21.533649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f418dc-11fe-4f50-a51f-5d7a48846ad4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:21.535854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f418dc-11fe-4f50-a51f-5d7a48846ad4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:21.551498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 346/699] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:21.552473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f418dc-11fe-4f50-a51f-5d7a48846ad4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:21.591075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8147-7f60-4f20-b617-9ff41a391116 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:21.599112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:21.615651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:21.627216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b248e-8cff-466f-a45b-f3e76daac443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:21.628047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b248e-8cff-466f-a45b-f3e76daac443 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.628333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b248e-8cff-466f-a45b-f3e76daac443 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.628608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b248e-8cff-466f-a45b-f3e76daac443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.640203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b248e-8cff-466f-a45b-f3e76daac443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:21.641674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b248e-8cff-466f-a45b-f3e76daac443 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-c97b248e-8cff-466f-a45b-f3e76daac443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:21.659769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:21.660841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:21.661767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:21.661767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:21.661767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:21.661767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:21.665905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 354/700] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:21.666789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b248e-8cff-466f-a45b-f3e76daac443 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:21.667783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f418dc-11fe-4f50-a51f-5d7a48846ad4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:21.706037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234529ec-ecd7-4692-8851-49a8ebb1425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:21.707026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234529ec-ecd7-4692-8851-49a8ebb1425a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.707549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234529ec-ecd7-4692-8851-49a8ebb1425a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.708048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234529ec-ecd7-4692-8851-49a8ebb1425a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.771763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b248e-8cff-466f-a45b-f3e76daac443 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:21.785532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234529ec-ecd7-4692-8851-49a8ebb1425a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:21.787116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234529ec-ecd7-4692-8851-49a8ebb1425a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:21.808569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583dc08-2f0e-424a-8786-7ea2f49be22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:21.809790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583dc08-2f0e-424a-8786-7ea2f49be22f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.810074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583dc08-2f0e-424a-8786-7ea2f49be22f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.810350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583dc08-2f0e-424a-8786-7ea2f49be22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.811210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583dc08-2f0e-424a-8786-7ea2f49be22f None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=bb4d690feb01473eaee368408c8a1dab) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:21.811523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583dc08-2f0e-424a-8786-7ea2f49be22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:21.813188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583dc08-2f0e-424a-8786-7ea2f49be22f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:21.820558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 355/701] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:21 2022] GET /identity/v3/role_assignments?user.id=bb4d690feb01473eaee368408c8a1dab&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:21.821485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583dc08-2f0e-424a-8786-7ea2f49be22f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:21.860251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:21.868540 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:21.931286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583dc08-2f0e-424a-8786-7ea2f49be22f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:21.949396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 347/702] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:21.954945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234529ec-ecd7-4692-8851-49a8ebb1425a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:21.969613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7257-ff9d-411e-a3f4-2abb90924fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:21.970372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7257-ff9d-411e-a3f4-2abb90924fdd None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:21.970780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7257-ff9d-411e-a3f4-2abb90924fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:21.971184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7257-ff9d-411e-a3f4-2abb90924fdd None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:21.972117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7257-ff9d-411e-a3f4-2abb90924fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:21.972533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7257-ff9d-411e-a3f4-2abb90924fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:21.974142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7257-ff9d-411e-a3f4-2abb90924fdd None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:21.987808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 356/703] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:21.994195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7257-ff9d-411e-a3f4-2abb90924fdd None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:22.080799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234529ec-ecd7-4692-8851-49a8ebb1425a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:22.103649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7257-ff9d-411e-a3f4-2abb90924fdd None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:22.106268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:22.141932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b9276-8379-4f4d-b447-e3c6f743d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:22.142792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b9276-8379-4f4d-b447-e3c6f743d0ee None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.143179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b9276-8379-4f4d-b447-e3c6f743d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.143557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b9276-8379-4f4d-b447-e3c6f743d0ee None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.144546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b9276-8379-4f4d-b447-e3c6f743d0ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:22.146307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b9276-8379-4f4d-b447-e3c6f743d0ee None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:22.153141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66407348-f2ed-469a-92b1-7e59ab93bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:22.153963 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407348-f2ed-469a-92b1-7e59ab93bd35 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.154253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407348-f2ed-469a-92b1-7e59ab93bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.154531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407348-f2ed-469a-92b1-7e59ab93bd35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.171321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66407348-f2ed-469a-92b1-7e59ab93bd35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:22.173201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:22.173701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66407348-f2ed-469a-92b1-7e59ab93bd35 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-66407348-f2ed-469a-92b1-7e59ab93bd35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:22.193175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:22.194109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:22.195019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:22.195019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:22.195019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:22.195019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:22.197320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 348/704] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:22.202867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66407348-f2ed-469a-92b1-7e59ab93bd35 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:22.247570 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 357/705] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:02:21 2022] POST /identity/v3/users => generated 254 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:02:22.248787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea8caa-8842-4f7e-9d7a-9d89a506ffff None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.249087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea8caa-8842-4f7e-9d7a-9d89a506ffff None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.249374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea8caa-8842-4f7e-9d7a-9d89a506ffff None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.250847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 358/706] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:22.259804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb755e-8c46-46bf-b75e-e67e7b97edf9 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.260159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb755e-8c46-46bf-b75e-e67e7b97edf9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.260496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb755e-8c46-46bf-b75e-e67e7b97edf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.291042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-27eb755e-8c46-46bf-b75e-e67e7b97edf9 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:22.292364 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-27eb755e-8c46-46bf-b75e-e67e7b97edf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:22.330029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66407348-f2ed-469a-92b1-7e59ab93bd35 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:22.374854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21eed5b-34d5-4d4b-b3c8-b7d6990ddd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:22.376636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eed5b-34d5-4d4b-b3c8-b7d6990ddd9e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.377143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eed5b-34d5-4d4b-b3c8-b7d6990ddd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.377616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eed5b-34d5-4d4b-b3c8-b7d6990ddd9e None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.378598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21eed5b-34d5-4d4b-b3c8-b7d6990ddd9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:22.378981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21eed5b-34d5-4d4b-b3c8-b7d6990ddd9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:22.380588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21eed5b-34d5-4d4b-b3c8-b7d6990ddd9e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:22.397907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 349/707] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:22.403437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 359/708] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:22.409586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21eed5b-34d5-4d4b-b3c8-b7d6990ddd9e None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:22.431580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb755e-8c46-46bf-b75e-e67e7b97edf9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:22.488944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:22.544820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:22.563539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21eed5b-34d5-4d4b-b3c8-b7d6990ddd9e None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:22.564160 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb755e-8c46-46bf-b75e-e67e7b97edf9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:22.602330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a669f64-4fa2-4b78-96e2-212ede87264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:22.603212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669f64-4fa2-4b78-96e2-212ede87264b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.603550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669f64-4fa2-4b78-96e2-212ede87264b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.603829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a669f64-4fa2-4b78-96e2-212ede87264b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.604520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a669f64-4fa2-4b78-96e2-212ede87264b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:22.605607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c77708-0b04-49e6-a5ce-f5dd89e23bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:22.606052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a669f64-4fa2-4b78-96e2-212ede87264b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:22.607059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c77708-0b04-49e6-a5ce-f5dd89e23bba None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.607548 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c77708-0b04-49e6-a5ce-f5dd89e23bba None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.608071 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c77708-0b04-49e6-a5ce-f5dd89e23bba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.615654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c77708-0b04-49e6-a5ce-f5dd89e23bba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:22.617408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c77708-0b04-49e6-a5ce-f5dd89e23bba None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-8a669f64-4fa2-4b78-96e2-212ede87264b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:22.623044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:22.624373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:02:22.625221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:22.627675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 360/709] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Jun 2 13:02:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:22.630553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a669f64-4fa2-4b78-96e2-212ede87264b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-47c77708-0b04-49e6-a5ce-f5dd89e23bba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:22.636494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:22.637894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:22.638773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:22.638773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:22.638773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:22.638773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:22.638773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:22.638773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:22.638773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:22.638773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:22.641283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 350/710] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:22.646956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c77708-0b04-49e6-a5ce-f5dd89e23bba None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:22.748189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a669f64-4fa2-4b78-96e2-212ede87264b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:22.753639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c77708-0b04-49e6-a5ce-f5dd89e23bba None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:22.768249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:22.787092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe705c-a691-49ef-ac9b-cb3605673e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:22.787762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe705c-a691-49ef-ac9b-cb3605673e65 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.788077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe705c-a691-49ef-ac9b-cb3605673e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.788352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe705c-a691-49ef-ac9b-cb3605673e65 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.789065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe705c-a691-49ef-ac9b-cb3605673e65 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:22.789387 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe705c-a691-49ef-ac9b-cb3605673e65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:22.790742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe705c-a691-49ef-ac9b-cb3605673e65 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:22.792295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc738f2e-e96a-4e26-8089-d6cafdb53921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:22.793232 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc738f2e-e96a-4e26-8089-d6cafdb53921 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.793755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc738f2e-e96a-4e26-8089-d6cafdb53921 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.794235 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc738f2e-e96a-4e26-8089-d6cafdb53921 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.795289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc738f2e-e96a-4e26-8089-d6cafdb53921 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:22.795811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc738f2e-e96a-4e26-8089-d6cafdb53921 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:22.797474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc738f2e-e96a-4e26-8089-d6cafdb53921 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:22.800090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 361/711] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Jun 2 13:02:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:22.802301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe705c-a691-49ef-ac9b-cb3605673e65 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:22.816363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 351/712] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:22.818814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc738f2e-e96a-4e26-8089-d6cafdb53921 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:22.821803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:22.916468 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe705c-a691-49ef-ac9b-cb3605673e65 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:22.936202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc738f2e-e96a-4e26-8089-d6cafdb53921 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:22.954088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9436e-b4a9-46c4-8b1a-20554b795d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:22.954801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9436e-b4a9-46c4-8b1a-20554b795d64 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.955134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9436e-b4a9-46c4-8b1a-20554b795d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.955414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9436e-b4a9-46c4-8b1a-20554b795d64 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.956157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9436e-b4a9-46c4-8b1a-20554b795d64 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:22.956463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9436e-b4a9-46c4-8b1a-20554b795d64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:22.958050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9436e-b4a9-46c4-8b1a-20554b795d64 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:22.968076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 362/713] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Jun 2 13:02:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:22.977749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cea2f6-9221-4267-936e-1c2c1d61496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:22.978845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cea2f6-9221-4267-936e-1c2c1d61496e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:22.979342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cea2f6-9221-4267-936e-1c2c1d61496e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:22.979830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cea2f6-9221-4267-936e-1c2c1d61496e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:22.980999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cea2f6-9221-4267-936e-1c2c1d61496e None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=ae1c6084061f4434864e9f7bcc553733) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:22.981554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cea2f6-9221-4267-936e-1c2c1d61496e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:22.983285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cea2f6-9221-4267-936e-1c2c1d61496e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:22.990760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 352/714] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:22 2022] GET /identity/v3/role_assignments?user.id=ae1c6084061f4434864e9f7bcc553733&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=31c5600d1f984a04827cf0052fc61678 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:23.535059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc573e9-ab90-429b-8132-a8b56efdbdfc None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:23.535411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc573e9-ab90-429b-8132-a8b56efdbdfc None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:23.535733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc573e9-ab90-429b-8132-a8b56efdbdfc None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:23.537436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 363/715] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:23.543922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0deb-2aa0-45e8-82cd-a3e4f6649b3f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:23.544223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0deb-2aa0-45e8-82cd-a3e4f6649b3f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:23.544499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0deb-2aa0-45e8-82cd-a3e4f6649b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:23.563530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-e82d0deb-2aa0-45e8-82cd-a3e4f6649b3f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:23.564739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e82d0deb-2aa0-45e8-82cd-a3e4f6649b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:23.608486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:23.659357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 353/716] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:23.689663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc573e9-ab90-429b-8132-a8b56efdbdfc None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:23.786471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:23.810333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc573e9-ab90-429b-8132-a8b56efdbdfc None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:23.845654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32f324-c934-4e61-bcdc-6f0241a8f01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:23.846456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32f324-c934-4e61-bcdc-6f0241a8f01d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:23.846733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32f324-c934-4e61-bcdc-6f0241a8f01d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:23.847003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32f324-c934-4e61-bcdc-6f0241a8f01d None admin] PATH_INFO: `/v3/services/network` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:23.847654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32f324-c934-4e61-bcdc-6f0241a8f01d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:23.849056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32f324-c934-4e61-bcdc-6f0241a8f01d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-fa32f324-c934-4e61-bcdc-6f0241a8f01d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:23.861817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:23.862787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:23.863621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 364/717] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:23 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:23.872943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d0deb-2aa0-45e8-82cd-a3e4f6649b3f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:23.989261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d0deb-2aa0-45e8-82cd-a3e4f6649b3f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:24.041326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c0162-2467-4d03-a73c-b40fee9ac407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:24.042006 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0162-2467-4d03-a73c-b40fee9ac407 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:24.042288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0162-2467-4d03-a73c-b40fee9ac407 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:24.042620 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0162-2467-4d03-a73c-b40fee9ac407 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:24.044447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c0162-2467-4d03-a73c-b40fee9ac407 None admin] RBAC: Adding query filter params (name=network) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:24.044764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c0162-2467-4d03-a73c-b40fee9ac407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:24.046136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c0162-2467-4d03-a73c-b40fee9ac407 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:24.053628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 354/718] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:24.058905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32f324-c934-4e61-bcdc-6f0241a8f01d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:24.171917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32f324-c934-4e61-bcdc-6f0241a8f01d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:24.207719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dd6d7-87ce-4003-bed8-7fcb7006f31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:24.208469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dd6d7-87ce-4003-bed8-7fcb7006f31c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:24.208751 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dd6d7-87ce-4003-bed8-7fcb7006f31c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:24.209070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dd6d7-87ce-4003-bed8-7fcb7006f31c None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:24.209781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dd6d7-87ce-4003-bed8-7fcb7006f31c None admin] RBAC: Adding query filter params (type=network) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:24.210081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dd6d7-87ce-4003-bed8-7fcb7006f31c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:24.211556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dd6d7-87ce-4003-bed8-7fcb7006f31c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:24.217564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 365/719] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:25.010556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdc76e-4cb9-4cd6-a2ca-5983df2bc88c None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:25.011490 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdc76e-4cb9-4cd6-a2ca-5983df2bc88c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:25.011946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdc76e-4cb9-4cd6-a2ca-5983df2bc88c None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:25.013831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 355/720] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:25.019568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4542-6db6-4b5d-aa59-eeab13ec43e5 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:25.020518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4542-6db6-4b5d-aa59-eeab13ec43e5 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:25.021003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4542-6db6-4b5d-aa59-eeab13ec43e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:25.037847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:25.044352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-c27d4542-6db6-4b5d-aa59-eeab13ec43e5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:25.045554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c27d4542-6db6-4b5d-aa59-eeab13ec43e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:25.150553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 366/721] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:25.174927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdc76e-4cb9-4cd6-a2ca-5983df2bc88c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:25.206698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:25.294296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdc76e-4cb9-4cd6-a2ca-5983df2bc88c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:25.330302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7d6cd-2ced-4305-957e-dec0fa074a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:25.331111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7d6cd-2ced-4305-957e-dec0fa074a97 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:25.331402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7d6cd-2ced-4305-957e-dec0fa074a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:25.331678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7d6cd-2ced-4305-957e-dec0fa074a97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:25.343485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7d6cd-2ced-4305-957e-dec0fa074a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-d2d7d6cd-2ced-4305-957e-dec0fa074a97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:25.351401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:25.352390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:25.353799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 356/722] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:25.359420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d4542-6db6-4b5d-aa59-eeab13ec43e5 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:25.485167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d4542-6db6-4b5d-aa59-eeab13ec43e5 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:25.537226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245b2d4-b775-4733-afdc-f0deeac5bc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:25.537940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245b2d4-b775-4733-afdc-f0deeac5bc9f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:25.538232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245b2d4-b775-4733-afdc-f0deeac5bc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:25.538519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245b2d4-b775-4733-afdc-f0deeac5bc9f None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:25.539382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245b2d4-b775-4733-afdc-f0deeac5bc9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:25.539701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245b2d4-b775-4733-afdc-f0deeac5bc9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:25.541202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245b2d4-b775-4733-afdc-f0deeac5bc9f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:25.549442 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:25.558502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 367/723] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:25.564081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7d6cd-2ced-4305-957e-dec0fa074a97 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:25.710950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7d6cd-2ced-4305-957e-dec0fa074a97 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:25.732228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:25.748570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf09a92-4213-4f70-91c9-b6eae808856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:25.749668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf09a92-4213-4f70-91c9-b6eae808856a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:25.749668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf09a92-4213-4f70-91c9-b6eae808856a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:25.749954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf09a92-4213-4f70-91c9-b6eae808856a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:25.762844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf09a92-4213-4f70-91c9-b6eae808856a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:25.764351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf09a92-4213-4f70-91c9-b6eae808856a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-9cf09a92-4213-4f70-91c9-b6eae808856a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:25.783474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:25.784558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:25.786075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:25.786075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:25.786075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:25.786075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:25.786075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 357/724] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:25.790313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf09a92-4213-4f70-91c9-b6eae808856a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:25.790908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726934d-b201-4a06-91e8-e4ca3cbcfc48 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:25.791201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726934d-b201-4a06-91e8-e4ca3cbcfc48 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:25.791486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726934d-b201-4a06-91e8-e4ca3cbcfc48 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:25.793113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 368/725] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:25.798372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f52b6d-952b-4baf-a281-28bb1374a96d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:25.798660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f52b6d-952b-4baf-a281-28bb1374a96d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:25.798942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f52b6d-952b-4baf-a281-28bb1374a96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:25.840109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-85f52b6d-952b-4baf-a281-28bb1374a96d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:25.841348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-85f52b6d-952b-4baf-a281-28bb1374a96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:25.900003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf09a92-4213-4f70-91c9-b6eae808856a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:25.937959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e6b37-3d9d-449c-867a-f790464c5c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:25.939137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e6b37-3d9d-449c-867a-f790464c5c6d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:25.939488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e6b37-3d9d-449c-867a-f790464c5c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:25.939820 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e6b37-3d9d-449c-867a-f790464c5c6d None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:25.940581 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e6b37-3d9d-449c-867a-f790464c5c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:25.940890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e6b37-3d9d-449c-867a-f790464c5c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:25.942269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e6b37-3d9d-449c-867a-f790464c5c6d None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:25.956899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 358/726] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:25.962501 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e6b37-3d9d-449c-867a-f790464c5c6d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:25.966118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:26.012232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 369/727] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:26.013633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a287-300d-4186-99ce-75b48efb6b61 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.013913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a287-300d-4186-99ce-75b48efb6b61 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.014197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a287-300d-4186-99ce-75b48efb6b61 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.019681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 370/728] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:26.021117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e5b9-90f0-46c0-969a-b379195d4039 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.021404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e5b9-90f0-46c0-969a-b379195d4039 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.021681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e5b9-90f0-46c0-969a-b379195d4039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.040777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-18a4e5b9-90f0-46c0-969a-b379195d4039 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:26.042086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-18a4e5b9-90f0-46c0-969a-b379195d4039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:26.094537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e6b37-3d9d-449c-867a-f790464c5c6d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:26.134524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 371/729] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:02:26.135413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4e5b9-90f0-46c0-969a-b379195d4039 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:26.144647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca200ed-5248-46be-a217-007b620aeb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:26.145658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca200ed-5248-46be-a217-007b620aeb2c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.146046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca200ed-5248-46be-a217-007b620aeb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.151899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca200ed-5248-46be-a217-007b620aeb2c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.158900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca200ed-5248-46be-a217-007b620aeb2c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:26.160416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca200ed-5248-46be-a217-007b620aeb2c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-8ca200ed-5248-46be-a217-007b620aeb2c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:26.178313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:26.179313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:26.180653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 359/730] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:26.181257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb6e2b-9280-4b8e-a3a4-e7ca02808cce None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.181581 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb6e2b-9280-4b8e-a3a4-e7ca02808cce None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.181742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb6e2b-9280-4b8e-a3a4-e7ca02808cce None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.183139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 360/731] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:26.187720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb6e2b-9280-4b8e-a3a4-e7ca02808cce None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:26.219888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:26.260590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:26.268660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4e5b9-90f0-46c0-969a-b379195d4039 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:26.306015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb6e2b-9280-4b8e-a3a4-e7ca02808cce None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:26.307531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eae80-5b48-441c-93d5-53011110fce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:26.308499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eae80-5b48-441c-93d5-53011110fce5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.309489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eae80-5b48-441c-93d5-53011110fce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.309489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eae80-5b48-441c-93d5-53011110fce5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.325206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eae80-5b48-441c-93d5-53011110fce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-b44eae80-5b48-441c-93d5-53011110fce5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:26.333190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:26.334159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:26.335058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 372/732] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:26.335785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eae80-5b48-441c-93d5-53011110fce5 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:26.354337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e70ed-3703-43d2-9e60-966d650df597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:26.354865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e70ed-3703-43d2-9e60-966d650df597 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.355187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e70ed-3703-43d2-9e60-966d650df597 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.355467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e70ed-3703-43d2-9e60-966d650df597 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.367058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e70ed-3703-43d2-9e60-966d650df597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-e49e70ed-3703-43d2-9e60-966d650df597 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:26.374852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:26.376085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:26.376990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 361/733] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:26.381155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013faa-34a9-49e9-8074-aecae1c286d3 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.381446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013faa-34a9-49e9-8074-aecae1c286d3 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.381728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013faa-34a9-49e9-8074-aecae1c286d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.410266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-13013faa-34a9-49e9-8074-aecae1c286d3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:26.411464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-13013faa-34a9-49e9-8074-aecae1c286d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:26.475379 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eae80-5b48-441c-93d5-53011110fce5 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:26.488211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 362/734] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:26.489090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013faa-34a9-49e9-8074-aecae1c286d3 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:26.517788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:26.539751 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42f283-901f-40c9-997d-cc4b08a0b832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:26.545923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42f283-901f-40c9-997d-cc4b08a0b832 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.545923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42f283-901f-40c9-997d-cc4b08a0b832 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.545923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42f283-901f-40c9-997d-cc4b08a0b832 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.545923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42f283-901f-40c9-997d-cc4b08a0b832 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:26.545923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42f283-901f-40c9-997d-cc4b08a0b832 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:26.545923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42f283-901f-40c9-997d-cc4b08a0b832 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:26.560050 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:26.565845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 373/735] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Jun 2 13:02:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:26.566710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42f283-901f-40c9-997d-cc4b08a0b832 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:26.627499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013faa-34a9-49e9-8074-aecae1c286d3 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:26.687854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e71e8-7f26-4f41-8f39-76cd0b1a1dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:26.688585 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e71e8-7f26-4f41-8f39-76cd0b1a1dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.688871 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e71e8-7f26-4f41-8f39-76cd0b1a1dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.689152 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e71e8-7f26-4f41-8f39-76cd0b1a1dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.689948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e71e8-7f26-4f41-8f39-76cd0b1a1dc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:26.690266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e71e8-7f26-4f41-8f39-76cd0b1a1dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:26.691724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e71e8-7f26-4f41-8f39-76cd0b1a1dc2 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:26.702184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 363/736] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:26.703114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e71e8-7f26-4f41-8f39-76cd0b1a1dc2 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:26.737618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42f283-901f-40c9-997d-cc4b08a0b832 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:26.784583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0729d-a999-403a-87f7-653a593f9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:26.785361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0729d-a999-403a-87f7-653a593f9b08 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.785717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0729d-a999-403a-87f7-653a593f9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.786070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0729d-a999-403a-87f7-653a593f9b08 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.786909 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0729d-a999-403a-87f7-653a593f9b08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:26.787292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0729d-a999-403a-87f7-653a593f9b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:26.788805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0729d-a999-403a-87f7-653a593f9b08 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:26.799341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 374/737] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:26.800020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0729d-a999-403a-87f7-653a593f9b08 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:26.820275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e71e8-7f26-4f41-8f39-76cd0b1a1dc2 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:26.834771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:26.849207 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:26.855550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846a5b8-80a7-4b9b-bcca-a4452d2f1fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:26.856257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846a5b8-80a7-4b9b-bcca-a4452d2f1fc1 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.856617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846a5b8-80a7-4b9b-bcca-a4452d2f1fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.856898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846a5b8-80a7-4b9b-bcca-a4452d2f1fc1 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.857623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846a5b8-80a7-4b9b-bcca-a4452d2f1fc1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:26.858997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846a5b8-80a7-4b9b-bcca-a4452d2f1fc1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:26.915276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0729d-a999-403a-87f7-653a593f9b08 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:26.950256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645abc-d1b4-49c6-95ab-5ebbdec04c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:26.950917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645abc-d1b4-49c6-95ab-5ebbdec04c58 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:26.951200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645abc-d1b4-49c6-95ab-5ebbdec04c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:26.951477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645abc-d1b4-49c6-95ab-5ebbdec04c58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:26.979906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 364/738] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:02:26 2022] POST /identity/v3/services => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:02:26.979906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846a5b8-80a7-4b9b-bcca-a4452d2f1fc1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:27.043415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35645abc-d1b4-49c6-95ab-5ebbdec04c58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:27.044937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35645abc-d1b4-49c6-95ab-5ebbdec04c58 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:27.091908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:27.124952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846a5b8-80a7-4b9b-bcca-a4452d2f1fc1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:27.165384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2695bdf-0208-4135-8bb0-78d70a5d9fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:27.166139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2695bdf-0208-4135-8bb0-78d70a5d9fcf None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:27.166427 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2695bdf-0208-4135-8bb0-78d70a5d9fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:27.166731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2695bdf-0208-4135-8bb0-78d70a5d9fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:27.170026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 375/739] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:02:27.171132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645abc-d1b4-49c6-95ab-5ebbdec04c58 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:27.185841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2695bdf-0208-4135-8bb0-78d70a5d9fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:27.187349 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2695bdf-0208-4135-8bb0-78d70a5d9fcf None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-c2695bdf-0208-4135-8bb0-78d70a5d9fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:27.208419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:27.209362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:27.210253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:27.210253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:27.210253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:27.210253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:27.210253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 365/740] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:27.211194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd0a67-dad4-476c-8aea-9d659a48fa95 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:27.211370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd0a67-dad4-476c-8aea-9d659a48fa95 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:27.211622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd0a67-dad4-476c-8aea-9d659a48fa95 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:27.215286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 366/741] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:27.215286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd0a67-dad4-476c-8aea-9d659a48fa95 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:27.247329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:27.308256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645abc-d1b4-49c6-95ab-5ebbdec04c58 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:27.346646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5529-83b6-4a7f-9a81-4d20c790cdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:27.347590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5529-83b6-4a7f-9a81-4d20c790cdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:27.347979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5529-83b6-4a7f-9a81-4d20c790cdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:27.348741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5529-83b6-4a7f-9a81-4d20c790cdf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:27.359341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:27.361579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b5529-83b6-4a7f-9a81-4d20c790cdf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:27.363069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b5529-83b6-4a7f-9a81-4d20c790cdf6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:27.371321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd0a67-dad4-476c-8aea-9d659a48fa95 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-317b5529-83b6-4a7f-9a81-4d20c790cdf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:27.382444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:27.383393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:27.384307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:27.384307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:27.384307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:27.384307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:27.384307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 376/742] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:27.384575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5529-83b6-4a7f-9a81-4d20c790cdf6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:27.426005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b512c-b3a6-4532-aad2-b73a21c10e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:27.427124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b512c-b3a6-4532-aad2-b73a21c10e6c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:27.427545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b512c-b3a6-4532-aad2-b73a21c10e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:27.427987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b512c-b3a6-4532-aad2-b73a21c10e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:27.440885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b512c-b3a6-4532-aad2-b73a21c10e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:27.442347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b512c-b3a6-4532-aad2-b73a21c10e6c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-677b512c-b3a6-4532-aad2-b73a21c10e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:27.462757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:27.463864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:27.465329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:27.465329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:27.465329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:27.465329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:27.465329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 367/743] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:27.465649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4bbd3-6ad0-496d-8af1-ed3c15bdbdf4 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:27.465933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4bbd3-6ad0-496d-8af1-ed3c15bdbdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:27.466203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4bbd3-6ad0-496d-8af1-ed3c15bdbdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:27.485899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-50d4bbd3-6ad0-496d-8af1-ed3c15bdbdf4 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:27.487114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-50d4bbd3-6ad0-496d-8af1-ed3c15bdbdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:27.506238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5529-83b6-4a7f-9a81-4d20c790cdf6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:27.549668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5c30-3d75-45ec-af3d-de640efb5d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:27.550712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5c30-3d75-45ec-af3d-de640efb5d3b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:27.551134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5c30-3d75-45ec-af3d-de640efb5d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:27.551552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5c30-3d75-45ec-af3d-de640efb5d3b None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:27.556894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5c30-3d75-45ec-af3d-de640efb5d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:27.556894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5c30-3d75-45ec-af3d-de640efb5d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:27.556894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5c30-3d75-45ec-af3d-de640efb5d3b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:27.563792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 368/744] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:02:27.564691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4bbd3-6ad0-496d-8af1-ed3c15bdbdf4 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:27.569362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 377/745] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:27.570529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5c30-3d75-45ec-af3d-de640efb5d3b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:27.575653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:27.630713 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:27.695379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4bbd3-6ad0-496d-8af1-ed3c15bdbdf4 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:27.705851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5c30-3d75-45ec-af3d-de640efb5d3b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:27.734933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba2d4-94f2-482f-913a-1b9e622e729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:27.735597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba2d4-94f2-482f-913a-1b9e622e729f None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:27.735885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba2d4-94f2-482f-913a-1b9e622e729f None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:27.736183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba2d4-94f2-482f-913a-1b9e622e729f None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:27.736906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba2d4-94f2-482f-913a-1b9e622e729f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:27.737210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba2d4-94f2-482f-913a-1b9e622e729f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:27.738583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba2d4-94f2-482f-913a-1b9e622e729f None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:27.749633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578e317-abb4-4e99-883a-9768569b4ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:27.750555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578e317-abb4-4e99-883a-9768569b4ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:27.750982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578e317-abb4-4e99-883a-9768569b4ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:27.751425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578e317-abb4-4e99-883a-9768569b4ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:27.752295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 369/746] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:27.752492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578e317-abb4-4e99-883a-9768569b4ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:27.752921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578e317-abb4-4e99-883a-9768569b4ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:27.753146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba2d4-94f2-482f-913a-1b9e622e729f None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:27.754745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578e317-abb4-4e99-883a-9768569b4ef6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:27.769618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 378/747] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:27.770458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578e317-abb4-4e99-883a-9768569b4ef6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:27.855704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:27.898263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578e317-abb4-4e99-883a-9768569b4ef6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:27.904991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba2d4-94f2-482f-913a-1b9e622e729f None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:27.912177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:27.936103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bcdcf-f0b1-49c9-bc1d-23518da35eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:27.936775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bcdcf-f0b1-49c9-bc1d-23518da35eef None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:27.937058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bcdcf-f0b1-49c9-bc1d-23518da35eef None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:27.937331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bcdcf-f0b1-49c9-bc1d-23518da35eef None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:27.938052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bcdcf-f0b1-49c9-bc1d-23518da35eef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:27.939439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bcdcf-f0b1-49c9-bc1d-23518da35eef None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:27.940905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c342c8-416d-472d-ade1-78d0c46d13ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:27.941726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c342c8-416d-472d-ade1-78d0c46d13ec None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:27.942007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c342c8-416d-472d-ade1-78d0c46d13ec None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:27.942281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c342c8-416d-472d-ade1-78d0c46d13ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:27.951192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c342c8-416d-472d-ade1-78d0c46d13ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:27.952643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c342c8-416d-472d-ade1-78d0c46d13ec None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-38c342c8-416d-472d-ade1-78d0c46d13ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:27.969899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:27.976197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 370/748] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Jun 2 13:02:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:27.977143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c342c8-416d-472d-ade1-78d0c46d13ec None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:28.010515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 379/749] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:02:27 2022] POST /identity/v3/services => generated 240 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:02:28.021137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bcdcf-f0b1-49c9-bc1d-23518da35eef None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:28.103296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c342c8-416d-472d-ade1-78d0c46d13ec None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:28.139863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:28.164539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d89fc-14f0-4030-8a85-a58ce8a903e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:28.166380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d89fc-14f0-4030-8a85-a58ce8a903e1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:28.166887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d89fc-14f0-4030-8a85-a58ce8a903e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:28.167519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d89fc-14f0-4030-8a85-a58ce8a903e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:28.176173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bcdcf-f0b1-49c9-bc1d-23518da35eef None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:28.185392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d89fc-14f0-4030-8a85-a58ce8a903e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:28.188071 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d89fc-14f0-4030-8a85-a58ce8a903e1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-e91d89fc-14f0-4030-8a85-a58ce8a903e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:28.210713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:28.211929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:28.213082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:28.213082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:28.213082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:28.213082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:28.213082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:28.213082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:28.213082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:28.213082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:28.213082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:28.213082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:28.220384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 371/750] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Jun 2 13:02:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:28.221774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d89fc-14f0-4030-8a85-a58ce8a903e1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:28.223273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698e3c7-d356-4194-9625-380d06a3c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:28.224253 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698e3c7-d356-4194-9625-380d06a3c18b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:28.224693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698e3c7-d356-4194-9625-380d06a3c18b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:28.225067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698e3c7-d356-4194-9625-380d06a3c18b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:28.232836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698e3c7-d356-4194-9625-380d06a3c18b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:28.234340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698e3c7-d356-4194-9625-380d06a3c18b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-b698e3c7-d356-4194-9625-380d06a3c18b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:28.250166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:28.251105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:28.252038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:28.252038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:28.252038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:28.252038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:28.252038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:28.252038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:28.252038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:28.252038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:28.252038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 380/751] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:28.252990 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698e3c7-d356-4194-9625-380d06a3c18b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:28.297608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:28.367898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d89fc-14f0-4030-8a85-a58ce8a903e1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:28.374881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698e3c7-d356-4194-9625-380d06a3c18b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:28.412890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f9d4c-4322-4a84-9f31-5a8ac4333b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:28.413576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f9d4c-4322-4a84-9f31-5a8ac4333b4f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:28.413853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f9d4c-4322-4a84-9f31-5a8ac4333b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:28.414131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f9d4c-4322-4a84-9f31-5a8ac4333b4f None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:28.414987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f9d4c-4322-4a84-9f31-5a8ac4333b4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:28.415295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f9d4c-4322-4a84-9f31-5a8ac4333b4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:28.416762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec1789-4987-4d95-9927-b20857100016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:28.416904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f9d4c-4322-4a84-9f31-5a8ac4333b4f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:28.417446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec1789-4987-4d95-9927-b20857100016 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:28.417765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec1789-4987-4d95-9927-b20857100016 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:28.418045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec1789-4987-4d95-9927-b20857100016 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:28.418945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec1789-4987-4d95-9927-b20857100016 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:28.419263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec1789-4987-4d95-9927-b20857100016 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:28.420760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec1789-4987-4d95-9927-b20857100016 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:28.436282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 381/752] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Jun 2 13:02:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:28.437161 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f9d4c-4322-4a84-9f31-5a8ac4333b4f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:28.445537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 372/753] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Jun 2 13:02:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:28.446404 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec1789-4987-4d95-9927-b20857100016 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:28.494596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:28.531037 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:28.544358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f9d4c-4322-4a84-9f31-5a8ac4333b4f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:28.572889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec1789-4987-4d95-9927-b20857100016 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:28.584194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2d4f7-ab7c-41aa-b0e7-798409cd144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:28.584975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2d4f7-ab7c-41aa-b0e7-798409cd144c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:28.585302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2d4f7-ab7c-41aa-b0e7-798409cd144c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:28.585569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2d4f7-ab7c-41aa-b0e7-798409cd144c None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:28.586469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2d4f7-ab7c-41aa-b0e7-798409cd144c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:28.586784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2d4f7-ab7c-41aa-b0e7-798409cd144c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:28.588288 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2d4f7-ab7c-41aa-b0e7-798409cd144c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:28.601953 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 382/754] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:28.602853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2d4f7-ab7c-41aa-b0e7-798409cd144c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:28.621703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bc5f4-ab2b-48a2-a8f4-a5a7bad4e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:28.622521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bc5f4-ab2b-48a2-a8f4-a5a7bad4e409 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:28.622811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bc5f4-ab2b-48a2-a8f4-a5a7bad4e409 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:28.623094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bc5f4-ab2b-48a2-a8f4-a5a7bad4e409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:28.636779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bc5f4-ab2b-48a2-a8f4-a5a7bad4e409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:28.638773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bc5f4-ab2b-48a2-a8f4-a5a7bad4e409 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-d33bc5f4-ab2b-48a2-a8f4-a5a7bad4e409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:28.662339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:28.663301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:28.664227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:28.664227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:28.664227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:28.664227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:28.668113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 373/755] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:28.669447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bc5f4-ab2b-48a2-a8f4-a5a7bad4e409 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:28.736475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2d4f7-ab7c-41aa-b0e7-798409cd144c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:28.773110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c317f-472d-4027-a75f-3245b02dc16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:28.773702 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c317f-472d-4027-a75f-3245b02dc16f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:28.773989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c317f-472d-4027-a75f-3245b02dc16f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:28.774271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c317f-472d-4027-a75f-3245b02dc16f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:28.788625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bc5f4-ab2b-48a2-a8f4-a5a7bad4e409 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:28.792229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:28.794532 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:28.833680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09585318-7a2c-494d-9e96-1f3107b2c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:28.834790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09585318-7a2c-494d-9e96-1f3107b2c309 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:28.835285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09585318-7a2c-494d-9e96-1f3107b2c309 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:28.836148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09585318-7a2c-494d-9e96-1f3107b2c309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:28.837655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09585318-7a2c-494d-9e96-1f3107b2c309 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=bb4d690feb01473eaee368408c8a1dab) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:28.838181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09585318-7a2c-494d-9e96-1f3107b2c309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:28.840580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09585318-7a2c-494d-9e96-1f3107b2c309 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:28.849959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 374/756] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:28 2022] GET /identity/v3/role_assignments?user.id=bb4d690feb01473eaee368408c8a1dab&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=31c5600d1f984a04827cf0052fc61678 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:28.851258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09585318-7a2c-494d-9e96-1f3107b2c309 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:28.896873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c317f-472d-4027-a75f-3245b02dc16f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:28.898380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c317f-472d-4027-a75f-3245b02dc16f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:28.996877 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09585318-7a2c-494d-9e96-1f3107b2c309 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:29.066552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93697dcf-8c52-4e9c-b01a-5d6d7f31cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:29.067661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93697dcf-8c52-4e9c-b01a-5d6d7f31cf94 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:29.068191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93697dcf-8c52-4e9c-b01a-5d6d7f31cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:29.068685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93697dcf-8c52-4e9c-b01a-5d6d7f31cf94 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:29.070284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93697dcf-8c52-4e9c-b01a-5d6d7f31cf94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:29.070902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93697dcf-8c52-4e9c-b01a-5d6d7f31cf94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:29.072668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93697dcf-8c52-4e9c-b01a-5d6d7f31cf94 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:29.087820 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 375/757] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:29.093521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93697dcf-8c52-4e9c-b01a-5d6d7f31cf94 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:29.120288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:29.208363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93697dcf-8c52-4e9c-b01a-5d6d7f31cf94 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:29.248467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eded3e-2516-4b00-8439-affcbe70d302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:29.249731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eded3e-2516-4b00-8439-affcbe70d302 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:29.250217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eded3e-2516-4b00-8439-affcbe70d302 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:29.250697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eded3e-2516-4b00-8439-affcbe70d302 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:29.258536 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eded3e-2516-4b00-8439-affcbe70d302 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:29.259580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 383/758] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:02:29.261060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eded3e-2516-4b00-8439-affcbe70d302 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:29.268969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c317f-472d-4027-a75f-3245b02dc16f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-d8eded3e-2516-4b00-8439-affcbe70d302 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:29.278437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:29.279379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:29.280266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:29.280266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:29.280266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:29.280266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:29.280266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:29.280266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:29.280266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:29.280266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:29.282885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 376/759] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:29.289525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eded3e-2516-4b00-8439-affcbe70d302 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:29.423362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:29.514484 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:29.517120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c317f-472d-4027-a75f-3245b02dc16f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:29.556630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eded3e-2516-4b00-8439-affcbe70d302 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:29.557121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94304a9d-df91-466d-8cd8-96d17bef9330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:29.557629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94304a9d-df91-466d-8cd8-96d17bef9330 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:29.557908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94304a9d-df91-466d-8cd8-96d17bef9330 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:29.558714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94304a9d-df91-466d-8cd8-96d17bef9330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:29.571776 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94304a9d-df91-466d-8cd8-96d17bef9330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:29.573309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94304a9d-df91-466d-8cd8-96d17bef9330 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:29.605194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d328f-0ffb-49c4-865c-40cf4dbbb291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-94304a9d-df91-466d-8cd8-96d17bef9330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:29.605640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:29.606470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:29.607975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:29.607975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:29.607975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:29.607975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:29.608257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d328f-0ffb-49c4-865c-40cf4dbbb291 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:29.608257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d328f-0ffb-49c4-865c-40cf4dbbb291 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:29.608257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d328f-0ffb-49c4-865c-40cf4dbbb291 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:29.608257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d328f-0ffb-49c4-865c-40cf4dbbb291 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:29.608504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 384/760] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:29.608570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d328f-0ffb-49c4-865c-40cf4dbbb291 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:29.608636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce420c8-c617-4d73-97e3-45fae52105b8 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:29.608880 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce420c8-c617-4d73-97e3-45fae52105b8 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:29.609057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce420c8-c617-4d73-97e3-45fae52105b8 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:29.610390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d328f-0ffb-49c4-865c-40cf4dbbb291 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:29.610641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 385/761] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:29.612440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce420c8-c617-4d73-97e3-45fae52105b8 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:29.631281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 377/762] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:29.633382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7ae9-5a9c-4f7d-bad1-6778527bba18 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:29.633797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7ae9-5a9c-4f7d-bad1-6778527bba18 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:29.634089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7ae9-5a9c-4f7d-bad1-6778527bba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:29.658425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a28c7ae9-5a9c-4f7d-bad1-6778527bba18 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:29.660547 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a28c7ae9-5a9c-4f7d-bad1-6778527bba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:29.752040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 378/763] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:29.752925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c7ae9-5a9c-4f7d-bad1-6778527bba18 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:29.755043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:29.768429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce420c8-c617-4d73-97e3-45fae52105b8 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:29.834188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3e7e7-172a-4362-b6b9-55d16216560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:29.834936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e7e7-172a-4362-b6b9-55d16216560a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:29.835269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e7e7-172a-4362-b6b9-55d16216560a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:29.835550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e7e7-172a-4362-b6b9-55d16216560a None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:29.836354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3e7e7-172a-4362-b6b9-55d16216560a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:29.836664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3e7e7-172a-4362-b6b9-55d16216560a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:29.838067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3e7e7-172a-4362-b6b9-55d16216560a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:29.851000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 386/764] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:29.852020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3e7e7-172a-4362-b6b9-55d16216560a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:29.857257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:29.910935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c7ae9-5a9c-4f7d-bad1-6778527bba18 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:29.955540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950334ac-89c9-4610-98fc-9e7e1e9cb3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:29.956520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950334ac-89c9-4610-98fc-9e7e1e9cb3cf None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:29.956808 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950334ac-89c9-4610-98fc-9e7e1e9cb3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:29.957090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950334ac-89c9-4610-98fc-9e7e1e9cb3cf None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/ae1c6084061f4434864e9f7bcc553733/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:29.959137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950334ac-89c9-4610-98fc-9e7e1e9cb3cf None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=ae1c6084061f4434864e9f7bcc553733, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:29.960689 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950334ac-89c9-4610-98fc-9e7e1e9cb3cf None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:29.985086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3e7e7-172a-4362-b6b9-55d16216560a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:30.026922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea689eee-4711-4194-af52-31ac982a15f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:30.027759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea689eee-4711-4194-af52-31ac982a15f3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:30.028091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea689eee-4711-4194-af52-31ac982a15f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:30.028372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea689eee-4711-4194-af52-31ac982a15f3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:30.029051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea689eee-4711-4194-af52-31ac982a15f3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:30.030495 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea689eee-4711-4194-af52-31ac982a15f3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-ea689eee-4711-4194-af52-31ac982a15f3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:30.048590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:30.049651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:02:30.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:30.054081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 387/766] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Jun 2 13:02:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:30.055530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea689eee-4711-4194-af52-31ac982a15f3 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:30.056092 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 379/766] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:02:29 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/ae1c6084061f4434864e9f7bcc553733/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:02:30.070141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950334ac-89c9-4610-98fc-9e7e1e9cb3cf None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:30.099063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:30.213548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea689eee-4711-4194-af52-31ac982a15f3 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:30.264410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c28c4-7f30-403e-9bdf-eae2c634a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:30.265711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c28c4-7f30-403e-9bdf-eae2c634a069 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:30.266098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c28c4-7f30-403e-9bdf-eae2c634a069 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:30.266476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c28c4-7f30-403e-9bdf-eae2c634a069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:30.275307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c28c4-7f30-403e-9bdf-eae2c634a069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:30.277277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c28c4-7f30-403e-9bdf-eae2c634a069 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-f44c28c4-7f30-403e-9bdf-eae2c634a069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:30.300673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:30.301650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:30.302523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:30.302523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:30.302523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:30.302523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:30.302523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:30.302523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:30.302523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:30.302523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:30.304425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 388/767] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:30.310808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c28c4-7f30-403e-9bdf-eae2c634a069 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:30.388896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950334ac-89c9-4610-98fc-9e7e1e9cb3cf None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:30.424071 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:30.439374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1f32-7d9b-4728-82cd-457e48f9daec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:30.440423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1f32-7d9b-4728-82cd-457e48f9daec None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:30.441012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1f32-7d9b-4728-82cd-457e48f9daec None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:30.441446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1f32-7d9b-4728-82cd-457e48f9daec None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:30.442642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb1f32-7d9b-4728-82cd-457e48f9daec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:30.443101 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb1f32-7d9b-4728-82cd-457e48f9daec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:30.444651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb1f32-7d9b-4728-82cd-457e48f9daec None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:30.445071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:30.448294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c28c4-7f30-403e-9bdf-eae2c634a069 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:30.451926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 380/768] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Jun 2 13:02:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:30.463167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1f32-7d9b-4728-82cd-457e48f9daec None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:30.527716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9ef52-868b-4d75-b0e1-1258e9a75e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:30.529096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9ef52-868b-4d75-b0e1-1258e9a75e27 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:30.529951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9ef52-868b-4d75-b0e1-1258e9a75e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:30.530688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9ef52-868b-4d75-b0e1-1258e9a75e27 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:30.537870 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9ef52-868b-4d75-b0e1-1258e9a75e27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:30.538545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9ef52-868b-4d75-b0e1-1258e9a75e27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:30.540536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9ef52-868b-4d75-b0e1-1258e9a75e27 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:30.571990 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 389/769] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:30.578038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9ef52-868b-4d75-b0e1-1258e9a75e27 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:30.690808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9ef52-868b-4d75-b0e1-1258e9a75e27 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:30.702848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1f32-7d9b-4728-82cd-457e48f9daec None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:30.728704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da4a03-d40f-4e7f-ba03-bd2b2b950632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:30.729495 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da4a03-d40f-4e7f-ba03-bd2b2b950632 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:30.729786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da4a03-d40f-4e7f-ba03-bd2b2b950632 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:30.730213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da4a03-d40f-4e7f-ba03-bd2b2b950632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:30.731071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da4a03-d40f-4e7f-ba03-bd2b2b950632 None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=4683d277112848ce9b49db3b15aaa32c) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:30.731385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da4a03-d40f-4e7f-ba03-bd2b2b950632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:30.732875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da4a03-d40f-4e7f-ba03-bd2b2b950632 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:30.739475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 390/770] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:30 2022] GET /identity/v3/role_assignments?user.id=4683d277112848ce9b49db3b15aaa32c&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:30.749413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5983-4c9b-4319-9ade-2c7e81812352 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:30.749762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5983-4c9b-4319-9ade-2c7e81812352 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:30.750104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5983-4c9b-4319-9ade-2c7e81812352 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:30.751674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 391/771] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:30.759916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83773a-99b5-41ef-a8ba-43feb5a8a4a5 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:30.760311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83773a-99b5-41ef-a8ba-43feb5a8a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:30.760462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83773a-99b5-41ef-a8ba-43feb5a8a4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:30.766962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b715d7-53ee-4350-b5f8-f3b8bfd06f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:30.768144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b715d7-53ee-4350-b5f8-f3b8bfd06f6b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:30.768635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b715d7-53ee-4350-b5f8-f3b8bfd06f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:30.769145 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b715d7-53ee-4350-b5f8-f3b8bfd06f6b None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:30.770484 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b715d7-53ee-4350-b5f8-f3b8bfd06f6b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:30.771026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b715d7-53ee-4350-b5f8-f3b8bfd06f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:30.773566 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b715d7-53ee-4350-b5f8-f3b8bfd06f6b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:30.785142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 381/772] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Jun 2 13:02:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:30.788280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8b83773a-99b5-41ef-a8ba-43feb5a8a4a5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:30.789517 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8b83773a-99b5-41ef-a8ba-43feb5a8a4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:30.792080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:30.793621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b715d7-53ee-4350-b5f8-f3b8bfd06f6b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:30.903086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:30.919928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 392/773] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:30.967594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b715d7-53ee-4350-b5f8-f3b8bfd06f6b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:30.987428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83773a-99b5-41ef-a8ba-43feb5a8a4a5 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:31.013775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29757b5e-97fb-406d-8e5d-4b2a439e1dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:31.014779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757b5e-97fb-406d-8e5d-4b2a439e1dff None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:31.016572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757b5e-97fb-406d-8e5d-4b2a439e1dff None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:31.017023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757b5e-97fb-406d-8e5d-4b2a439e1dff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:31.019146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29757b5e-97fb-406d-8e5d-4b2a439e1dff None admin] RBAC: Adding query filter params (interface=public, service_id=1634cb584e954bd59d24a6de885a0924, region_id=RegionOne) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:31.019664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29757b5e-97fb-406d-8e5d-4b2a439e1dff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:31.022673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29757b5e-97fb-406d-8e5d-4b2a439e1dff None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:31.036678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 382/774] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Jun 2 13:02:30 2022] GET /identity/v3/endpoints?service_id=1634cb584e954bd59d24a6de885a0924&interface=public®ion_id=RegionOne => generated 194 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:31.044772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29757b5e-97fb-406d-8e5d-4b2a439e1dff None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:31.228209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83773a-99b5-41ef-a8ba-43feb5a8a4a5 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:31.250285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29757b5e-97fb-406d-8e5d-4b2a439e1dff None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:31.279268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac961a4-dd0e-4370-ac9a-df64573d59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:31.280241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac961a4-dd0e-4370-ac9a-df64573d59a7 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:31.280528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac961a4-dd0e-4370-ac9a-df64573d59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:31.280802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac961a4-dd0e-4370-ac9a-df64573d59a7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:31.281249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:31.281537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac961a4-dd0e-4370-ac9a-df64573d59a7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:31.282861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac961a4-dd0e-4370-ac9a-df64573d59a7 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-2ac961a4-dd0e-4370-ac9a-df64573d59a7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:31.305966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:31.307091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:31.308456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 393/775] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:30 2022] GET /identity/v3/services/network => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:31.309254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac961a4-dd0e-4370-ac9a-df64573d59a7 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:31.314597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:31.330498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4b45-a1f3-4f12-9541-57ec9f84cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:31.331711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4b45-a1f3-4f12-9541-57ec9f84cefd None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:31.332265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4b45-a1f3-4f12-9541-57ec9f84cefd None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:31.332779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4b45-a1f3-4f12-9541-57ec9f84cefd None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:31.334103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c4b45-a1f3-4f12-9541-57ec9f84cefd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:31.336813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c4b45-a1f3-4f12-9541-57ec9f84cefd None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:31.343430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 383/776] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Jun 2 13:02:31 2022] GET /identity/v3/services => generated 772 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:31.469006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac961a4-dd0e-4370-ac9a-df64573d59a7 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:31.510213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33a0e3-716d-439a-b612-acd9c2e052b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:31.510873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33a0e3-716d-439a-b612-acd9c2e052b9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:31.511195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33a0e3-716d-439a-b612-acd9c2e052b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:31.511475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33a0e3-716d-439a-b612-acd9c2e052b9 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:31.512307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33a0e3-716d-439a-b612-acd9c2e052b9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:31.512607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33a0e3-716d-439a-b612-acd9c2e052b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:31.514080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33a0e3-716d-439a-b612-acd9c2e052b9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:31.522298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 394/777] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:31.527908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4b45-a1f3-4f12-9541-57ec9f84cefd None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:31.649300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058958a-9929-4286-82ff-3f3ea7a844a8 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:31.649678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058958a-9929-4286-82ff-3f3ea7a844a8 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:31.649860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058958a-9929-4286-82ff-3f3ea7a844a8 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:31.651449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 395/778] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:31.656802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528745d-e7f8-42cf-ba27-b25123184e5c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:31.657100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528745d-e7f8-42cf-ba27-b25123184e5c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:31.657371 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528745d-e7f8-42cf-ba27-b25123184e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:31.667932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4b45-a1f3-4f12-9541-57ec9f84cefd None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:31.677138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-6528745d-e7f8-42cf-ba27-b25123184e5c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:31.678346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6528745d-e7f8-42cf-ba27-b25123184e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:31.713109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4a5ff-8ec4-4818-93a2-12b7902e2ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:31.713874 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4a5ff-8ec4-4818-93a2-12b7902e2ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:31.714284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4a5ff-8ec4-4818-93a2-12b7902e2ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:31.714746 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4a5ff-8ec4-4818-93a2-12b7902e2ae1 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:31.715467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4a5ff-8ec4-4818-93a2-12b7902e2ae1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:31.715777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4a5ff-8ec4-4818-93a2-12b7902e2ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:31.717452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4a5ff-8ec4-4818-93a2-12b7902e2ae1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:31.723451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 384/779] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:31.729311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4a5ff-8ec4-4818-93a2-12b7902e2ae1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:31.744515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:31.754253 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 396/780] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:31.776975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528745d-e7f8-42cf-ba27-b25123184e5c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:31.785325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:31.853066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4a5ff-8ec4-4818-93a2-12b7902e2ae1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:31.884074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528745d-e7f8-42cf-ba27-b25123184e5c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:31.894340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595038-f9ad-4f42-9c6f-255722e29007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:31.895503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595038-f9ad-4f42-9c6f-255722e29007 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:31.896128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595038-f9ad-4f42-9c6f-255722e29007 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:31.896591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595038-f9ad-4f42-9c6f-255722e29007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:31.897953 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595038-f9ad-4f42-9c6f-255722e29007 None admin] RBAC: Adding query filter params (interface=public, service_id=caae5291a5fb4fd5a5d9c7517c13dc0e, region_id=RegionOne) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:31.898437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595038-f9ad-4f42-9c6f-255722e29007 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:31.900909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595038-f9ad-4f42-9c6f-255722e29007 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:31.908315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 385/781] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Jun 2 13:02:31 2022] GET /identity/v3/endpoints?service_id=caae5291a5fb4fd5a5d9c7517c13dc0e&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:31.916870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595038-f9ad-4f42-9c6f-255722e29007 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:31.923036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801d723-615a-48e7-a8b9-ba1718f74e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:31.923862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801d723-615a-48e7-a8b9-ba1718f74e6c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:31.924190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801d723-615a-48e7-a8b9-ba1718f74e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:31.924466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801d723-615a-48e7-a8b9-ba1718f74e6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:31.936536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801d723-615a-48e7-a8b9-ba1718f74e6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-a801d723-615a-48e7-a8b9-ba1718f74e6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:31.944628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:31.945590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:31.946875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 397/782] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:31.952073 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801d723-615a-48e7-a8b9-ba1718f74e6c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:32.012726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:32.059772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801d723-615a-48e7-a8b9-ba1718f74e6c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:32.096750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f36b97-aa8b-4748-9b96-dd1bab279163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:32.097577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f36b97-aa8b-4748-9b96-dd1bab279163 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:32.097950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f36b97-aa8b-4748-9b96-dd1bab279163 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:32.098321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f36b97-aa8b-4748-9b96-dd1bab279163 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:32.099169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f36b97-aa8b-4748-9b96-dd1bab279163 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:32.099576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f36b97-aa8b-4748-9b96-dd1bab279163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:32.101198 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f36b97-aa8b-4748-9b96-dd1bab279163 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:32.111235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 398/783] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:32.117400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f36b97-aa8b-4748-9b96-dd1bab279163 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:32.157960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595038-f9ad-4f42-9c6f-255722e29007 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:32.176458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:32.224391 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f36b97-aa8b-4748-9b96-dd1bab279163 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:32.256280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:32.264733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afec34-9a11-480d-aabb-f47eb6df5ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:32.265686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afec34-9a11-480d-aabb-f47eb6df5ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:32.266074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afec34-9a11-480d-aabb-f47eb6df5ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:32.266471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afec34-9a11-480d-aabb-f47eb6df5ab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:32.278930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afec34-9a11-480d-aabb-f47eb6df5ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:32.280613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afec34-9a11-480d-aabb-f47eb6df5ab4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:32.292663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c9477-4515-47a1-90de-c5b5a5cc6478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:32.293354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c9477-4515-47a1-90de-c5b5a5cc6478 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:32.293642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c9477-4515-47a1-90de-c5b5a5cc6478 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:32.293922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c9477-4515-47a1-90de-c5b5a5cc6478 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:32.294614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c9477-4515-47a1-90de-c5b5a5cc6478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:32.296039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c9477-4515-47a1-90de-c5b5a5cc6478 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-a7afec34-9a11-480d-aabb-f47eb6df5ab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:32.299085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:32.300001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:32.302243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:32.302243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:32.302243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:32.302243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:32.302243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 399/784] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:32.306726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afec34-9a11-480d-aabb-f47eb6df5ab4 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:32.314631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 386/785] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Jun 2 13:02:31 2022] GET /identity/v3/services => generated 772 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:32.421901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afec34-9a11-480d-aabb-f47eb6df5ab4 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:32.461562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a0d6a-9c90-4a43-ada7-c8d13cf076e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:32.462258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0d6a-9c90-4a43-ada7-c8d13cf076e4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:32.462547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0d6a-9c90-4a43-ada7-c8d13cf076e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:32.462891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0d6a-9c90-4a43-ada7-c8d13cf076e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:32.463644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a0d6a-9c90-4a43-ada7-c8d13cf076e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:32.463990 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a0d6a-9c90-4a43-ada7-c8d13cf076e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:32.465997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a0d6a-9c90-4a43-ada7-c8d13cf076e4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:32.484293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 400/786] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:32.485906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c9477-4515-47a1-90de-c5b5a5cc6478 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:32.605987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c9477-4515-47a1-90de-c5b5a5cc6478 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:32.642807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256eb1c-02d4-482c-993e-6d032d271c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:32.643616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256eb1c-02d4-482c-993e-6d032d271c56 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:32.643922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256eb1c-02d4-482c-993e-6d032d271c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:32.644206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256eb1c-02d4-482c-993e-6d032d271c56 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:32.652600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256eb1c-02d4-482c-993e-6d032d271c56 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:32.654064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256eb1c-02d4-482c-993e-6d032d271c56 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-6256eb1c-02d4-482c-993e-6d032d271c56 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:32.669044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:32.671261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:32.673726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 387/787] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:32.680517 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a0d6a-9c90-4a43-ada7-c8d13cf076e4 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:32.712333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:32.785757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a0d6a-9c90-4a43-ada7-c8d13cf076e4 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:32.822179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e61e-02c1-4141-bebc-88eb47e68e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:32.822866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e61e-02c1-4141-bebc-88eb47e68e0c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:32.823153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e61e-02c1-4141-bebc-88eb47e68e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:32.823430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e61e-02c1-4141-bebc-88eb47e68e0c None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:32.824872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e61e-02c1-4141-bebc-88eb47e68e0c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:32.825184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e61e-02c1-4141-bebc-88eb47e68e0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:32.826627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e61e-02c1-4141-bebc-88eb47e68e0c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:32.846036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 401/788] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Jun 2 13:02:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:32.851526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256eb1c-02d4-482c-993e-6d032d271c56 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:32.887361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:32.963633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256eb1c-02d4-482c-993e-6d032d271c56 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:33.000478 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401bb67-fb38-4ab7-9014-0a2094b3f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:33.001301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401bb67-fb38-4ab7-9014-0a2094b3f652 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:33.001586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401bb67-fb38-4ab7-9014-0a2094b3f652 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:33.001864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401bb67-fb38-4ab7-9014-0a2094b3f652 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:33.013799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401bb67-fb38-4ab7-9014-0a2094b3f652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:33.015285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401bb67-fb38-4ab7-9014-0a2094b3f652 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-2401bb67-fb38-4ab7-9014-0a2094b3f652 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:33.033592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:33.035833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:33.038223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:33.038223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:33.038223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:33.038223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:33.038223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 388/789] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:33.045223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e61e-02c1-4141-bebc-88eb47e68e0c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:33.199381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:33.214874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e61e-02c1-4141-bebc-88eb47e68e0c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:33.266560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c69c7-ed62-4ae8-b46a-4031ff5005cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:33.267254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c69c7-ed62-4ae8-b46a-4031ff5005cf None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:33.267538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c69c7-ed62-4ae8-b46a-4031ff5005cf None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:33.267816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c69c7-ed62-4ae8-b46a-4031ff5005cf None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:33.268576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c69c7-ed62-4ae8-b46a-4031ff5005cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:33.268883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c69c7-ed62-4ae8-b46a-4031ff5005cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:33.270259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c69c7-ed62-4ae8-b46a-4031ff5005cf None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:33.287145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 402/790] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:33.292816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401bb67-fb38-4ab7-9014-0a2094b3f652 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:33.456279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:33.463919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401bb67-fb38-4ab7-9014-0a2094b3f652 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:33.500944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8e141-8f6f-418c-828d-0351efc4baf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:33.501681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8e141-8f6f-418c-828d-0351efc4baf7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:33.501971 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8e141-8f6f-418c-828d-0351efc4baf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:33.502252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8e141-8f6f-418c-828d-0351efc4baf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:33.509599 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8e141-8f6f-418c-828d-0351efc4baf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:33.511115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8e141-8f6f-418c-828d-0351efc4baf7 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-33c8e141-8f6f-418c-828d-0351efc4baf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:33.526401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:33.528076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:33.528980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:33.528980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:33.528980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:33.528980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:33.528980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:33.528980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:33.528980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:33.528980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:33.533684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 389/791] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:33.541034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c69c7-ed62-4ae8-b46a-4031ff5005cf None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:33.602644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8987ff6-e3b3-40f3-b5d7-db9aded7ce1d None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:33.603095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8987ff6-e3b3-40f3-b5d7-db9aded7ce1d None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:33.603385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8987ff6-e3b3-40f3-b5d7-db9aded7ce1d None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:33.606353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 390/792] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:33.617438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90476-b97a-4340-a8af-22bda12f15e8 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:33.617964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90476-b97a-4340-a8af-22bda12f15e8 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:33.618424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90476-b97a-4340-a8af-22bda12f15e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:33.650852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-3ca90476-b97a-4340-a8af-22bda12f15e8 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:33.652911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3ca90476-b97a-4340-a8af-22bda12f15e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:33.733525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c69c7-ed62-4ae8-b46a-4031ff5005cf None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:33.772827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123bbd6-b585-4020-a3ed-5a3eb06f3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:33.773793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123bbd6-b585-4020-a3ed-5a3eb06f3618 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:33.774338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123bbd6-b585-4020-a3ed-5a3eb06f3618 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:33.774782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123bbd6-b585-4020-a3ed-5a3eb06f3618 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:33.775849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123bbd6-b585-4020-a3ed-5a3eb06f3618 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:33.776349 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123bbd6-b585-4020-a3ed-5a3eb06f3618 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:33.778387 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123bbd6-b585-4020-a3ed-5a3eb06f3618 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:33.783827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 391/793] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:33.785497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e4521-8032-4464-848c-6935b5f711d8 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:33.786006 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e4521-8032-4464-848c-6935b5f711d8 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:33.786484 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e4521-8032-4464-848c-6935b5f711d8 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:33.788284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 392/794] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:33.793440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57078e-22b2-4d56-b342-d5a8a8b8de72 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:33.793989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57078e-22b2-4d56-b342-d5a8a8b8de72 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:33.794525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57078e-22b2-4d56-b342-d5a8a8b8de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:33.809647 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 403/795] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:33.816636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123bbd6-b585-4020-a3ed-5a3eb06f3618 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:33.822251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-7d57078e-22b2-4d56-b342-d5a8a8b8de72 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:33.825332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7d57078e-22b2-4d56-b342-d5a8a8b8de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:33.830910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:33.909800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 393/796] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:33.911134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57078e-22b2-4d56-b342-d5a8a8b8de72 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:33.916857 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:33.978189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123bbd6-b585-4020-a3ed-5a3eb06f3618 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:34.027827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf34e-8e22-4a39-a820-40e5a8e578a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:34.029421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf34e-8e22-4a39-a820-40e5a8e578a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:34.029877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf34e-8e22-4a39-a820-40e5a8e578a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:34.030318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf34e-8e22-4a39-a820-40e5a8e578a0 None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/bb4d690feb01473eaee368408c8a1dab/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:34.032528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf34e-8e22-4a39-a820-40e5a8e578a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=bb4d690feb01473eaee368408c8a1dab, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:34.034195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf34e-8e22-4a39-a820-40e5a8e578a0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:34.060079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57078e-22b2-4d56-b342-d5a8a8b8de72 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:34.099828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203d8cb-029b-4708-bed2-b0b45af3f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:34.100777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203d8cb-029b-4708-bed2-b0b45af3f0af None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:34.101070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203d8cb-029b-4708-bed2-b0b45af3f0af None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:34.101347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203d8cb-029b-4708-bed2-b0b45af3f0af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:34.104631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 404/797] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:02:33 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/bb4d690feb01473eaee368408c8a1dab/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:02:34.105846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf34e-8e22-4a39-a820-40e5a8e578a0 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:34.132552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203d8cb-029b-4708-bed2-b0b45af3f0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-0203d8cb-029b-4708-bed2-b0b45af3f0af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:34.155211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:34.156313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:34.157163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:34.161181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 394/798] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:34.167410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203d8cb-029b-4708-bed2-b0b45af3f0af None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:34.257381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:34.272915 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:34.300052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf34e-8e22-4a39-a820-40e5a8e578a0 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:34.315712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203d8cb-029b-4708-bed2-b0b45af3f0af None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:34.339748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247b41e-c439-4c19-94c8-6b22b2bb5eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:34.340965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247b41e-c439-4c19-94c8-6b22b2bb5eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:34.341459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247b41e-c439-4c19-94c8-6b22b2bb5eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:34.341937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247b41e-c439-4c19-94c8-6b22b2bb5eb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:34.353460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bbd28-a0f0-4aef-9075-f2947af87e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:34.353907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247b41e-c439-4c19-94c8-6b22b2bb5eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:34.354148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bbd28-a0f0-4aef-9075-f2947af87e43 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:34.354437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bbd28-a0f0-4aef-9075-f2947af87e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:34.354744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bbd28-a0f0-4aef-9075-f2947af87e43 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:34.355499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bbd28-a0f0-4aef-9075-f2947af87e43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:34.355808 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bbd28-a0f0-4aef-9075-f2947af87e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:34.357301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bbd28-a0f0-4aef-9075-f2947af87e43 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-2247b41e-c439-4c19-94c8-6b22b2bb5eb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:34.363579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:34.365049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:34.366068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:34.371917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 405/799] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:34.371917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d1395-f920-47e6-9e49-14428fc00795 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:34.371917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d1395-f920-47e6-9e49-14428fc00795 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:34.371917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d1395-f920-47e6-9e49-14428fc00795 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:34.372437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 395/800] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:34.376322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 406/801] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:34.378694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bbd28-a0f0-4aef-9075-f2947af87e43 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:34.380142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d1395-f920-47e6-9e49-14428fc00795 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:34.499467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bbd28-a0f0-4aef-9075-f2947af87e43 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:34.516497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d1395-f920-47e6-9e49-14428fc00795 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:34.536855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:34.549624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195e411-494f-480d-9391-2431361b1ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:34.550712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195e411-494f-480d-9391-2431361b1ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:34.551042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195e411-494f-480d-9391-2431361b1ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:34.551426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195e411-494f-480d-9391-2431361b1ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:34.552330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195e411-494f-480d-9391-2431361b1ef8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:34.552781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195e411-494f-480d-9391-2431361b1ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:34.553207 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:34.554445 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195e411-494f-480d-9391-2431361b1ef8 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:34.564385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227d785-60e9-484b-a699-e895a369ff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:34.565477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227d785-60e9-484b-a699-e895a369ff59 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:34.565900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227d785-60e9-484b-a699-e895a369ff59 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:34.566373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227d785-60e9-484b-a699-e895a369ff59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:34.570207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 396/802] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:34.571535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6330b1b-e63a-435f-b151-fde2f3a43c1c None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:34.571961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6330b1b-e63a-435f-b151-fde2f3a43c1c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:34.572351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6330b1b-e63a-435f-b151-fde2f3a43c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:34.581186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227d785-60e9-484b-a699-e895a369ff59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:34.582965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227d785-60e9-484b-a699-e895a369ff59 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:34.590717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c6330b1b-e63a-435f-b151-fde2f3a43c1c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:34.592146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c6330b1b-e63a-435f-b151-fde2f3a43c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-1227d785-60e9-484b-a699-e895a369ff59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:34.607624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:34.608945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:34.610062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:34.610062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:34.610062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:34.610062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:34.612232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 407/803] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:34.613977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227d785-60e9-484b-a699-e895a369ff59 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:34.680106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 397/804] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:34.681158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6330b1b-e63a-435f-b151-fde2f3a43c1c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:34.766789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227d785-60e9-484b-a699-e895a369ff59 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:34.810408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6330b1b-e63a-435f-b151-fde2f3a43c1c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:34.817853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f53ae8-aff7-45c0-9142-17ab36d0fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:34.818843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f53ae8-aff7-45c0-9142-17ab36d0fdfb None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:34.819233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f53ae8-aff7-45c0-9142-17ab36d0fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:34.820239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f53ae8-aff7-45c0-9142-17ab36d0fdfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:34.833448 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f53ae8-aff7-45c0-9142-17ab36d0fdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:34.835639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f53ae8-aff7-45c0-9142-17ab36d0fdfb None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:34.841173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:34.860863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d93334-fb14-48ff-a0d2-f73ce1f252e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-88f53ae8-aff7-45c0-9142-17ab36d0fdfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:34.861088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:34.871242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:34.872362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:34.872362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:34.872362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:34.872362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:34.872608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d93334-fb14-48ff-a0d2-f73ce1f252e5 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:34.872608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d93334-fb14-48ff-a0d2-f73ce1f252e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:34.872608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d93334-fb14-48ff-a0d2-f73ce1f252e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:34.872608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d93334-fb14-48ff-a0d2-f73ce1f252e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:34.872608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d93334-fb14-48ff-a0d2-f73ce1f252e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:34.872608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d93334-fb14-48ff-a0d2-f73ce1f252e5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:34.872960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 408/805] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:34.872960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f53ae8-aff7-45c0-9142-17ab36d0fdfb None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:34.883645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 398/806] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:34.884931 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d93334-fb14-48ff-a0d2-f73ce1f252e5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:34.918961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:35.021094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d93334-fb14-48ff-a0d2-f73ce1f252e5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:35.028939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f53ae8-aff7-45c0-9142-17ab36d0fdfb None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:35.071355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0cf0-079b-4389-bbda-9160f27efbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:35.072795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0cf0-079b-4389-bbda-9160f27efbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.073455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0cf0-079b-4389-bbda-9160f27efbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.074001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0cf0-079b-4389-bbda-9160f27efbc1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.074919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb0cf0-079b-4389-bbda-9160f27efbc1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:35.076502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb0cf0-079b-4389-bbda-9160f27efbc1 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:35.081030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce487d-13e0-4e58-a606-28cd4043eafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:35.081796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce487d-13e0-4e58-a606-28cd4043eafe None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.082328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce487d-13e0-4e58-a606-28cd4043eafe None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.082806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce487d-13e0-4e58-a606-28cd4043eafe None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.083615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce487d-13e0-4e58-a606-28cd4043eafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:35.084031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce487d-13e0-4e58-a606-28cd4043eafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:35.085479 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce487d-13e0-4e58-a606-28cd4043eafe None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-87cb0cf0-079b-4389-bbda-9160f27efbc1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:35.093555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:35.094523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:02:35.095361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:35.103222 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 409/807] 10.222.0.46 () {56 vars in 1129 bytes} [Thu Jun 2 13:02:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:35.103791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 399/808] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:35.104701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0cf0-079b-4389-bbda-9160f27efbc1 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:35.105547 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce487d-13e0-4e58-a606-28cd4043eafe None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:35.157449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:35.219523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:35.226985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb0cf0-079b-4389-bbda-9160f27efbc1 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:35.233411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce487d-13e0-4e58-a606-28cd4043eafe None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:35.267665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300552d-28ee-49f9-ae7b-1d35d938bd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:35.268613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300552d-28ee-49f9-ae7b-1d35d938bd7b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.269013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300552d-28ee-49f9-ae7b-1d35d938bd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.269290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300552d-28ee-49f9-ae7b-1d35d938bd7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.277609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0facab4-4a08-41f4-958b-1144977f925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:35.277919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300552d-28ee-49f9-ae7b-1d35d938bd7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:35.278301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0facab4-4a08-41f4-958b-1144977f925d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.278618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0facab4-4a08-41f4-958b-1144977f925d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.278892 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0facab4-4a08-41f4-958b-1144977f925d None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.279301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300552d-28ee-49f9-ae7b-1d35d938bd7b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:35.279598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0facab4-4a08-41f4-958b-1144977f925d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:35.280011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0facab4-4a08-41f4-958b-1144977f925d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:35.281384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0facab4-4a08-41f4-958b-1144977f925d None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:35.291149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 400/809] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Jun 2 13:02:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:35.291149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0facab4-4a08-41f4-958b-1144977f925d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-b300552d-28ee-49f9-ae7b-1d35d938bd7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:35.300223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:35.302109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:35.303077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:35.303077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:35.303077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:35.303077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:35.303077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:35.303077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:35.303077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:35.303077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:35.303077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:02:35.303077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:35.306186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 410/810] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Jun 2 13:02:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:35.307515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68cd51-be09-4957-962d-9cfba393b1e9 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.307843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68cd51-be09-4957-962d-9cfba393b1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.308662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68cd51-be09-4957-962d-9cfba393b1e9 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.310305 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 411/811] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:35.315118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68cd51-be09-4957-962d-9cfba393b1e9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:35.415806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0facab4-4a08-41f4-958b-1144977f925d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:35.418690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:35.448917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68cd51-be09-4957-962d-9cfba393b1e9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:35.458110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e47f0c-b621-4f99-a878-b6faa5a40595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:35.458941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e47f0c-b621-4f99-a878-b6faa5a40595 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.459230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e47f0c-b621-4f99-a878-b6faa5a40595 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.459511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e47f0c-b621-4f99-a878-b6faa5a40595 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.468567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e47f0c-b621-4f99-a878-b6faa5a40595 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:35.470190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e47f0c-b621-4f99-a878-b6faa5a40595 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-a2e47f0c-b621-4f99-a878-b6faa5a40595 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:35.487029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:35.488845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 401/812] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Jun 2 13:02:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:35.491594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e47f0c-b621-4f99-a878-b6faa5a40595 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:35.501512 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c035-2165-4e49-a447-80bcfca7bbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:35.502194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c035-2165-4e49-a447-80bcfca7bbba None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.502484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c035-2165-4e49-a447-80bcfca7bbba None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.502766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c035-2165-4e49-a447-80bcfca7bbba None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.503484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623c035-2165-4e49-a447-80bcfca7bbba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:35.503791 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623c035-2165-4e49-a447-80bcfca7bbba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:35.505222 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623c035-2165-4e49-a447-80bcfca7bbba None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:35.511257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 412/813] 10.222.0.46 () {56 vars in 1124 bytes} [Thu Jun 2 13:02:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:35.512437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2ebf4-35b5-4d93-b67d-b88c10f7f78a None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.512729 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2ebf4-35b5-4d93-b67d-b88c10f7f78a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.513008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2ebf4-35b5-4d93-b67d-b88c10f7f78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.536976 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a2b2ebf4-35b5-4d93-b67d-b88c10f7f78a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:35.538305 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a2b2ebf4-35b5-4d93-b67d-b88c10f7f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:35.556605 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:35.628235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 413/814] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:35.629275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2ebf4-35b5-4d93-b67d-b88c10f7f78a None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:35.637602 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e47f0c-b621-4f99-a878-b6faa5a40595 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:35.681786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e6a62-fbd8-43ec-a46f-fa5a8c975c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:35.683311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e6a62-fbd8-43ec-a46f-fa5a8c975c29 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.683827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e6a62-fbd8-43ec-a46f-fa5a8c975c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.684223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e6a62-fbd8-43ec-a46f-fa5a8c975c29 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.685156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e6a62-fbd8-43ec-a46f-fa5a8c975c29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:35.685475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e6a62-fbd8-43ec-a46f-fa5a8c975c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:35.686924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e6a62-fbd8-43ec-a46f-fa5a8c975c29 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:35.719799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 402/815] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Jun 2 13:02:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:35.719799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e6a62-fbd8-43ec-a46f-fa5a8c975c29 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:35.745403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:35.762930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2ebf4-35b5-4d93-b67d-b88c10f7f78a None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:35.804608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90b70f-5944-4b12-bf5e-ce0174afdc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:35.805352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90b70f-5944-4b12-bf5e-ce0174afdc2a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.805637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90b70f-5944-4b12-bf5e-ce0174afdc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.805934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90b70f-5944-4b12-bf5e-ce0174afdc2a None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.806785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90b70f-5944-4b12-bf5e-ce0174afdc2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:35.807090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90b70f-5944-4b12-bf5e-ce0174afdc2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:35.808600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90b70f-5944-4b12-bf5e-ce0174afdc2a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:35.833044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 414/816] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Jun 2 13:02:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:35.833904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90b70f-5944-4b12-bf5e-ce0174afdc2a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:35.846538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:35.858578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e6a62-fbd8-43ec-a46f-fa5a8c975c29 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:35.900780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738798f-a32b-49e9-8f39-64beea6a8108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:35.901959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738798f-a32b-49e9-8f39-64beea6a8108 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.902244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738798f-a32b-49e9-8f39-64beea6a8108 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.902518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738798f-a32b-49e9-8f39-64beea6a8108 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.903758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738798f-a32b-49e9-8f39-64beea6a8108 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:35.905337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738798f-a32b-49e9-8f39-64beea6a8108 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:35.956523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90b70f-5944-4b12-bf5e-ce0174afdc2a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:35.991692 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7d6b-ff05-45d0-9bed-f2f34b43bd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:35.992523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7d6b-ff05-45d0-9bed-f2f34b43bd5b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:35.992805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7d6b-ff05-45d0-9bed-f2f34b43bd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:35.993075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7d6b-ff05-45d0-9bed-f2f34b43bd5b None admin] PATH_INFO: `/v3/services/network` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:35.993724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e7d6b-ff05-45d0-9bed-f2f34b43bd5b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:35.995096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e7d6b-ff05-45d0-9bed-f2f34b43bd5b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-fb3e7d6b-ff05-45d0-9bed-f2f34b43bd5b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:36.007501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:36.008784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:36.009651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 415/817] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:35 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:36.010452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7d6b-ff05-45d0-9bed-f2f34b43bd5b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:36.039679 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 403/818] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Jun 2 13:02:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:02:36.040722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738798f-a32b-49e9-8f39-64beea6a8108 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:36.114313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:36.141916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:36.169009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7d6b-ff05-45d0-9bed-f2f34b43bd5b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:36.183444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738798f-a32b-49e9-8f39-64beea6a8108 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:36.216433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d649-f7c5-4816-912b-3b9e73650646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:36.217719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d649-f7c5-4816-912b-3b9e73650646 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:36.217719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d649-f7c5-4816-912b-3b9e73650646 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:36.217921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d649-f7c5-4816-912b-3b9e73650646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:36.239781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3123517-cfad-4953-b933-fb067956a15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:36.241077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3123517-cfad-4953-b933-fb067956a15a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:36.241582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3123517-cfad-4953-b933-fb067956a15a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:36.242440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3123517-cfad-4953-b933-fb067956a15a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:36.259554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3123517-cfad-4953-b933-fb067956a15a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:36.262898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3123517-cfad-4953-b933-fb067956a15a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-f3123517-cfad-4953-b933-fb067956a15a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:36.288590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:36.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:36.293434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:36.293434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:36.293434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:36.293434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:36.293434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 404/819] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:36.293434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3123517-cfad-4953-b933-fb067956a15a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:36.318320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4d649-f7c5-4816-912b-3b9e73650646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:36.320463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4d649-f7c5-4816-912b-3b9e73650646 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:36.419383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:36.424628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3123517-cfad-4953-b933-fb067956a15a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:36.450674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:36.458649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 416/820] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:02:36.459991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d649-f7c5-4816-912b-3b9e73650646 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:36.463264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346f001-f833-4890-afe5-e93a97eaa860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:36.464616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346f001-f833-4890-afe5-e93a97eaa860 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:36.465132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346f001-f833-4890-afe5-e93a97eaa860 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:36.465804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346f001-f833-4890-afe5-e93a97eaa860 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:36.466926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346f001-f833-4890-afe5-e93a97eaa860 None admin] RBAC: Adding query filter params (name=network) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:36.467746 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346f001-f833-4890-afe5-e93a97eaa860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:36.469267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346f001-f833-4890-afe5-e93a97eaa860 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:36.475074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 405/821] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:36.476315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346f001-f833-4890-afe5-e93a97eaa860 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:36.585851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d649-f7c5-4816-912b-3b9e73650646 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:36.621137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346f001-f833-4890-afe5-e93a97eaa860 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:36.630125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279c31c-c7cf-41c2-8d25-a5fa87ee810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:36.631186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279c31c-c7cf-41c2-8d25-a5fa87ee810b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:36.631477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279c31c-c7cf-41c2-8d25-a5fa87ee810b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:36.631753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279c31c-c7cf-41c2-8d25-a5fa87ee810b None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:36.632846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279c31c-c7cf-41c2-8d25-a5fa87ee810b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:36.633329 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279c31c-c7cf-41c2-8d25-a5fa87ee810b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:36.634715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279c31c-c7cf-41c2-8d25-a5fa87ee810b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:36.652473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 417/822] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:36.653002 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279c31c-c7cf-41c2-8d25-a5fa87ee810b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:36.660547 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b70d0-eb27-44c9-ad27-641b8f868823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:36.661345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b70d0-eb27-44c9-ad27-641b8f868823 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:36.661627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b70d0-eb27-44c9-ad27-641b8f868823 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:36.661900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b70d0-eb27-44c9-ad27-641b8f868823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:36.674739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b70d0-eb27-44c9-ad27-641b8f868823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:36.676363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b70d0-eb27-44c9-ad27-641b8f868823 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:36.692032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-f83b70d0-eb27-44c9-ad27-641b8f868823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:36.695368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:36.703038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:36.709573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:36.709573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:36.709573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:36.709573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:36.709573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 406/823] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:36.709573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47fea5-f7d3-41be-a5e4-a0661c073287 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:36.709573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47fea5-f7d3-41be-a5e4-a0661c073287 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:36.709573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47fea5-f7d3-41be-a5e4-a0661c073287 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:36.709573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 407/824] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:36.710441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47fea5-f7d3-41be-a5e4-a0661c073287 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:36.752983 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:36.791719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279c31c-c7cf-41c2-8d25-a5fa87ee810b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:36.826678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47fea5-f7d3-41be-a5e4-a0661c073287 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:36.835831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137d93-198b-4348-9806-a036b138a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:36.836546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137d93-198b-4348-9806-a036b138a01e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:36.836830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137d93-198b-4348-9806-a036b138a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:36.837110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137d93-198b-4348-9806-a036b138a01e None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:36.837831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b137d93-198b-4348-9806-a036b138a01e None admin] RBAC: Adding query filter params (type=network) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:36.838141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b137d93-198b-4348-9806-a036b138a01e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:36.840150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b137d93-198b-4348-9806-a036b138a01e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:36.845522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 418/825] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:36.849171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137d93-198b-4348-9806-a036b138a01e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:36.868495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27fa8d-853d-4078-9954-f8f819ae4690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:36.869300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27fa8d-853d-4078-9954-f8f819ae4690 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:36.869582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27fa8d-853d-4078-9954-f8f819ae4690 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:36.869855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27fa8d-853d-4078-9954-f8f819ae4690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:36.877385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27fa8d-853d-4078-9954-f8f819ae4690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:36.878846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27fa8d-853d-4078-9954-f8f819ae4690 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-7c27fa8d-853d-4078-9954-f8f819ae4690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:36.894279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:36.901044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 408/826] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a24c6-44a1-42eb-ac35-63bbdfbe3580 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:36.902542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a24c6-44a1-42eb-ac35-63bbdfbe3580 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:36.903134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a24c6-44a1-42eb-ac35-63bbdfbe3580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:36.926431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-291a24c6-44a1-42eb-ac35-63bbdfbe3580 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:36.927693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-291a24c6-44a1-42eb-ac35-63bbdfbe3580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:36.967137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:36.973462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137d93-198b-4348-9806-a036b138a01e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:37.009993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d417e-9006-4274-b5dd-5c7b1fcd73c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:37.010184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 409/827] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:37.011270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a24c6-44a1-42eb-ac35-63bbdfbe3580 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:37.011639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d417e-9006-4274-b5dd-5c7b1fcd73c3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:37.012088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d417e-9006-4274-b5dd-5c7b1fcd73c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:37.012486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d417e-9006-4274-b5dd-5c7b1fcd73c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:37.013341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d417e-9006-4274-b5dd-5c7b1fcd73c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:37.013996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d417e-9006-4274-b5dd-5c7b1fcd73c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:37.015492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d417e-9006-4274-b5dd-5c7b1fcd73c3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:37.031063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 419/828] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:37.036377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d417e-9006-4274-b5dd-5c7b1fcd73c3 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:37.056268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:37.140144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a24c6-44a1-42eb-ac35-63bbdfbe3580 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:37.158147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d417e-9006-4274-b5dd-5c7b1fcd73c3 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:37.181436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9f04f-138f-4d03-9aeb-26df2128e526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:37.182099 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9f04f-138f-4d03-9aeb-26df2128e526 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:37.182385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9f04f-138f-4d03-9aeb-26df2128e526 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:37.183192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9f04f-138f-4d03-9aeb-26df2128e526 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:37.183929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9f04f-138f-4d03-9aeb-26df2128e526 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:37.185313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9f04f-138f-4d03-9aeb-26df2128e526 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:37.199300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1b904-700e-4f38-b6bd-36939bd63a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:37.200242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1b904-700e-4f38-b6bd-36939bd63a91 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:37.200242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1b904-700e-4f38-b6bd-36939bd63a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:37.200528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1b904-700e-4f38-b6bd-36939bd63a91 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:37.202180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1b904-700e-4f38-b6bd-36939bd63a91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:37.202180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1b904-700e-4f38-b6bd-36939bd63a91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:37.203020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1b904-700e-4f38-b6bd-36939bd63a91 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:37.216464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 420/829] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:37.217304 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1b904-700e-4f38-b6bd-36939bd63a91 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:37.238339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:37.267993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 410/830] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Jun 2 13:02:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:02:37.267993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9f04f-138f-4d03-9aeb-26df2128e526 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:37.353699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1b904-700e-4f38-b6bd-36939bd63a91 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:37.392961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:37.410043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f00dd9-b72a-4d09-aa2c-d16f59a60d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:37.410043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00dd9-b72a-4d09-aa2c-d16f59a60d77 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:37.410043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00dd9-b72a-4d09-aa2c-d16f59a60d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:37.410043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f00dd9-b72a-4d09-aa2c-d16f59a60d77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:37.420503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9f04f-138f-4d03-9aeb-26df2128e526 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:37.424389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f00dd9-b72a-4d09-aa2c-d16f59a60d77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:37.425953 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f00dd9-b72a-4d09-aa2c-d16f59a60d77 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-a3f00dd9-b72a-4d09-aa2c-d16f59a60d77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:37.447010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:37.449803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:37.450900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:37.450900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:37.450900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:37.450900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:37.450900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:37.450900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:37.450900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:37.450900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:37.450900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 421/831] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:37.451584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f00dd9-b72a-4d09-aa2c-d16f59a60d77 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:37.488756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24290f-81de-48e2-9db5-1d68a1c9d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:37.489726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24290f-81de-48e2-9db5-1d68a1c9d441 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:37.490013 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24290f-81de-48e2-9db5-1d68a1c9d441 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:37.490341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24290f-81de-48e2-9db5-1d68a1c9d441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:37.508536 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24290f-81de-48e2-9db5-1d68a1c9d441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-1f24290f-81de-48e2-9db5-1d68a1c9d441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:37.516865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:37.517814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 411/832] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:37.523948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24290f-81de-48e2-9db5-1d68a1c9d441 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:37.552277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:37.593009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f00dd9-b72a-4d09-aa2c-d16f59a60d77 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:37.636133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3f0d6-a016-45f2-ae39-98052351ed4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:37.637146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3f0d6-a016-45f2-ae39-98052351ed4c None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:37.637488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3f0d6-a016-45f2-ae39-98052351ed4c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:37.637829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3f0d6-a016-45f2-ae39-98052351ed4c None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/4683d277112848ce9b49db3b15aaa32c/roles/268a1d65ee224ca3b6b59f003f936207` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:37.644883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24290f-81de-48e2-9db5-1d68a1c9d441 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:37.654331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3f0d6-a016-45f2-ae39-98052351ed4c None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=4683d277112848ce9b49db3b15aaa32c, role_id=268a1d65ee224ca3b6b59f003f936207)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:37.655781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3f0d6-a016-45f2-ae39-98052351ed4c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:37.680300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc610b-58e9-475d-b3ae-9179afd605ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:37.680982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc610b-58e9-475d-b3ae-9179afd605ce None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:37.681263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc610b-58e9-475d-b3ae-9179afd605ce None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:37.681533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc610b-58e9-475d-b3ae-9179afd605ce None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:37.682319 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc610b-58e9-475d-b3ae-9179afd605ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:37.682673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc610b-58e9-475d-b3ae-9179afd605ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:37.684676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc610b-58e9-475d-b3ae-9179afd605ce None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:37.698417 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 412/833] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:37.699291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc610b-58e9-475d-b3ae-9179afd605ce None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:37.709220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:37.730298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 422/834] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:02:37 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/4683d277112848ce9b49db3b15aaa32c/roles/268a1d65ee224ca3b6b59f003f936207 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:02:37.731346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3f0d6-a016-45f2-ae39-98052351ed4c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:37.858616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc610b-58e9-475d-b3ae-9179afd605ce None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:37.897123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3f0d6-a016-45f2-ae39-98052351ed4c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:37.910387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f3e8c-96a6-4528-bb52-900ec71482a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:37.911088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f3e8c-96a6-4528-bb52-900ec71482a6 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:37.911378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f3e8c-96a6-4528-bb52-900ec71482a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:37.911661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f3e8c-96a6-4528-bb52-900ec71482a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:37.912512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f3e8c-96a6-4528-bb52-900ec71482a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:37.912834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f3e8c-96a6-4528-bb52-900ec71482a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:37.914288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f3e8c-96a6-4528-bb52-900ec71482a6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:37.928977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 413/835] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:37.935397 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:37.938390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f3e8c-96a6-4528-bb52-900ec71482a6 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:37.956297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da002df-7b54-4f20-923d-a2094278d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:37.957037 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da002df-7b54-4f20-923d-a2094278d077 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:37.957322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da002df-7b54-4f20-923d-a2094278d077 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:37.957600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da002df-7b54-4f20-923d-a2094278d077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:37.958526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da002df-7b54-4f20-923d-a2094278d077 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=ae1c6084061f4434864e9f7bcc553733) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:37.958872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da002df-7b54-4f20-923d-a2094278d077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:37.960370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da002df-7b54-4f20-923d-a2094278d077 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:37.978099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 423/836] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:37 2022] GET /identity/v3/role_assignments?user.id=ae1c6084061f4434864e9f7bcc553733&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=31c5600d1f984a04827cf0052fc61678 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:38.030541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:38.068880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f3e8c-96a6-4528-bb52-900ec71482a6 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:38.114256 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c4fbb-4bf8-411b-9b7f-2c25fc5d8f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:38.115706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c4fbb-4bf8-411b-9b7f-2c25fc5d8f64 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:38.116232 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c4fbb-4bf8-411b-9b7f-2c25fc5d8f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:38.116723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c4fbb-4bf8-411b-9b7f-2c25fc5d8f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:38.129695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c4fbb-4bf8-411b-9b7f-2c25fc5d8f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:38.131565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c4fbb-4bf8-411b-9b7f-2c25fc5d8f64 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-e05c4fbb-4bf8-411b-9b7f-2c25fc5d8f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:38.152096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:38.153091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:38.153969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:38.153969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:38.153969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:38.153969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:38.156599 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 414/837] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:38.162528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da002df-7b54-4f20-923d-a2094278d077 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:38.282542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da002df-7b54-4f20-923d-a2094278d077 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:38.318239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723aff6-dc9b-49ea-91c4-213c1b453b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:38.319362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723aff6-dc9b-49ea-91c4-213c1b453b32 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:38.319847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723aff6-dc9b-49ea-91c4-213c1b453b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:38.320455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723aff6-dc9b-49ea-91c4-213c1b453b32 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:38.321386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723aff6-dc9b-49ea-91c4-213c1b453b32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:38.321889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723aff6-dc9b-49ea-91c4-213c1b453b32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:38.324061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723aff6-dc9b-49ea-91c4-213c1b453b32 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:38.337360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 424/838] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:38.347066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c4fbb-4bf8-411b-9b7f-2c25fc5d8f64 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:38.470152 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c4fbb-4bf8-411b-9b7f-2c25fc5d8f64 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:38.491612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:38.506109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304660ff-94cf-4c44-91bb-6a932dfdbb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:38.506929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304660ff-94cf-4c44-91bb-6a932dfdbb15 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:38.507218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304660ff-94cf-4c44-91bb-6a932dfdbb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:38.507496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304660ff-94cf-4c44-91bb-6a932dfdbb15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:38.516654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304660ff-94cf-4c44-91bb-6a932dfdbb15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:38.518137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304660ff-94cf-4c44-91bb-6a932dfdbb15 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:38.521518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759e3be-a952-44a6-9211-a77b0ebf05e3 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:38.521987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759e3be-a952-44a6-9211-a77b0ebf05e3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:38.522063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759e3be-a952-44a6-9211-a77b0ebf05e3 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:38.523819 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 425/839] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:38.529256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa1088-8c10-4fd2-a8e4-1cf08afac82e None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:38.529541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa1088-8c10-4fd2-a8e4-1cf08afac82e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:38.529820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa1088-8c10-4fd2-a8e4-1cf08afac82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-304660ff-94cf-4c44-91bb-6a932dfdbb15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:38.540639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:38.541633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:38.543098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:38.543098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:38.543098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:38.543098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:38.543098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:38.543098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:38.543098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:38.543098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:38.543098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:02:38.543098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:38.547371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 415/840] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:02:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:38.548716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304660ff-94cf-4c44-91bb-6a932dfdbb15 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:38.554783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-1aaa1088-8c10-4fd2-a8e4-1cf08afac82e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:38.556279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1aaa1088-8c10-4fd2-a8e4-1cf08afac82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:38.613281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:38.652031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 426/841] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:38.673332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa1088-8c10-4fd2-a8e4-1cf08afac82e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:38.697247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304660ff-94cf-4c44-91bb-6a932dfdbb15 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:38.742442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7369e-6f7b-4f68-8cf1-d5e228076134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:38.744593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7369e-6f7b-4f68-8cf1-d5e228076134 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:38.745416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7369e-6f7b-4f68-8cf1-d5e228076134 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:38.746106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7369e-6f7b-4f68-8cf1-d5e228076134 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:38.747645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7369e-6f7b-4f68-8cf1-d5e228076134 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:38.748535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7369e-6f7b-4f68-8cf1-d5e228076134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:38.750889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7369e-6f7b-4f68-8cf1-d5e228076134 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:38.771741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 416/842] 10.222.0.46 () {56 vars in 1135 bytes} [Thu Jun 2 13:02:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:38.778309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7369e-6f7b-4f68-8cf1-d5e228076134 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:38.780907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa1088-8c10-4fd2-a8e4-1cf08afac82e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:38.822053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:38.840317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503f421-1503-4728-84c4-4ea8f13e0394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:38.841127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503f421-1503-4728-84c4-4ea8f13e0394 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:38.841994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503f421-1503-4728-84c4-4ea8f13e0394 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:38.841994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503f421-1503-4728-84c4-4ea8f13e0394 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:38.843350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503f421-1503-4728-84c4-4ea8f13e0394 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:38.843813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503f421-1503-4728-84c4-4ea8f13e0394 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-3503f421-1503-4728-84c4-4ea8f13e0394 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:38.866416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:38.867496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:02:38.868394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:38.872909 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 427/843] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:02:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:38.874619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503f421-1503-4728-84c4-4ea8f13e0394 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:38.913568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7369e-6f7b-4f68-8cf1-d5e228076134 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:38.924269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:38.975687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad58ed4-31f5-4e43-bae8-24750bb55eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:38.977048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad58ed4-31f5-4e43-bae8-24750bb55eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:38.978044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad58ed4-31f5-4e43-bae8-24750bb55eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:38.978531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad58ed4-31f5-4e43-bae8-24750bb55eb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:39.010147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503f421-1503-4728-84c4-4ea8f13e0394 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:39.063348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc0093-221d-42a8-a897-ce2da78172a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:39.064064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc0093-221d-42a8-a897-ce2da78172a4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:39.064347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc0093-221d-42a8-a897-ce2da78172a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:39.064619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc0093-221d-42a8-a897-ce2da78172a4 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:39.065324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc0093-221d-42a8-a897-ce2da78172a4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:39.065625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc0093-221d-42a8-a897-ce2da78172a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:39.066993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc0093-221d-42a8-a897-ce2da78172a4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:39.072026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 428/844] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:02:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:39.078155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc0093-221d-42a8-a897-ce2da78172a4 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:39.086675 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad58ed4-31f5-4e43-bae8-24750bb55eb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:39.088519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad58ed4-31f5-4e43-bae8-24750bb55eb2 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:39.131807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:39.188566 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc0093-221d-42a8-a897-ce2da78172a4 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:39.191365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:39.203402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 417/845] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:02:39.210299 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad58ed4-31f5-4e43-bae8-24750bb55eb2 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:39.242272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ae96f-388f-4af7-b34e-00278c17d62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:39.243716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae96f-388f-4af7-b34e-00278c17d62c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:39.244257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae96f-388f-4af7-b34e-00278c17d62c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:39.245716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae96f-388f-4af7-b34e-00278c17d62c None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:39.246748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ae96f-388f-4af7-b34e-00278c17d62c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:39.247264 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ae96f-388f-4af7-b34e-00278c17d62c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:39.248925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ae96f-388f-4af7-b34e-00278c17d62c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:39.260465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 429/846] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:02:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:39.338283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad58ed4-31f5-4e43-bae8-24750bb55eb2 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:39.388710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba185ad-be3b-482e-88e5-0bbc1d1b47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:39.389891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba185ad-be3b-482e-88e5-0bbc1d1b47e2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:39.390385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba185ad-be3b-482e-88e5-0bbc1d1b47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:39.390857 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba185ad-be3b-482e-88e5-0bbc1d1b47e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:39.403901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:39.403901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba185ad-be3b-482e-88e5-0bbc1d1b47e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:39.405023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba185ad-be3b-482e-88e5-0bbc1d1b47e2 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-bba185ad-be3b-482e-88e5-0bbc1d1b47e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:39.432458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:39.433949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:39.434836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:39.434836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:39.434836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:39.434836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:39.434836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 418/847] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:39.440274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ae96f-388f-4af7-b34e-00278c17d62c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:39.547071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ae96f-388f-4af7-b34e-00278c17d62c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:39.581412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7397d-6a2d-4516-b550-ae7aebfbd297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:39.582080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7397d-6a2d-4516-b550-ae7aebfbd297 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:39.582361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7397d-6a2d-4516-b550-ae7aebfbd297 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:39.582637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7397d-6a2d-4516-b550-ae7aebfbd297 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:39.583360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7397d-6a2d-4516-b550-ae7aebfbd297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:39.583668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7397d-6a2d-4516-b550-ae7aebfbd297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:39.585081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7397d-6a2d-4516-b550-ae7aebfbd297 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:39.602555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 430/848] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:39.603920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba185ad-be3b-482e-88e5-0bbc1d1b47e2 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:39.708177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba185ad-be3b-482e-88e5-0bbc1d1b47e2 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:39.744411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9248aa-afaa-420f-839b-e2901f1095d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:39.745231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9248aa-afaa-420f-839b-e2901f1095d8 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:39.745508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9248aa-afaa-420f-839b-e2901f1095d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:39.745779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9248aa-afaa-420f-839b-e2901f1095d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:39.757087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9248aa-afaa-420f-839b-e2901f1095d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:39.758606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9248aa-afaa-420f-839b-e2901f1095d8 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-1d9248aa-afaa-420f-839b-e2901f1095d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:39.773577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:39.775613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:39.778361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:39.778361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:39.778361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:39.778361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:39.778361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:39.778361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:39.778361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:39.778361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:39.778361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 419/849] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:39.783912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7397d-6a2d-4516-b550-ae7aebfbd297 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:39.810476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:39.891906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7397d-6a2d-4516-b550-ae7aebfbd297 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:39.927402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acdaba-8a6c-433b-b57c-4a322c390e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:39.928114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acdaba-8a6c-433b-b57c-4a322c390e7b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:39.928397 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acdaba-8a6c-433b-b57c-4a322c390e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:39.928671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acdaba-8a6c-433b-b57c-4a322c390e7b None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:39.929459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acdaba-8a6c-433b-b57c-4a322c390e7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:39.929766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acdaba-8a6c-433b-b57c-4a322c390e7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:39.931255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acdaba-8a6c-433b-b57c-4a322c390e7b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:39.948968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 431/850] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:39.953045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9248aa-afaa-420f-839b-e2901f1095d8 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:40.012612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:40.077927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9248aa-afaa-420f-839b-e2901f1095d8 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:40.120911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29817f-e4a3-4fc0-a145-bf1ec87edee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:40.121591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29817f-e4a3-4fc0-a145-bf1ec87edee6 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:40.121868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29817f-e4a3-4fc0-a145-bf1ec87edee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:40.122142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29817f-e4a3-4fc0-a145-bf1ec87edee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:40.122986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29817f-e4a3-4fc0-a145-bf1ec87edee6 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=bb4d690feb01473eaee368408c8a1dab) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:40.123298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29817f-e4a3-4fc0-a145-bf1ec87edee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:40.124781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29817f-e4a3-4fc0-a145-bf1ec87edee6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:40.131756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 420/851] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:39 2022] GET /identity/v3/role_assignments?user.id=bb4d690feb01473eaee368408c8a1dab&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=31c5600d1f984a04827cf0052fc61678 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:40.209602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf26dc5-a0f0-4ad7-95dd-da068e209cd6 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:40.209982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf26dc5-a0f0-4ad7-95dd-da068e209cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:40.210347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf26dc5-a0f0-4ad7-95dd-da068e209cd6 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:40.212153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 432/852] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:40.218403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc318e8-ab76-4a48-90ea-75f910e59b79 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:40.218699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc318e8-ab76-4a48-90ea-75f910e59b79 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:40.218977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc318e8-ab76-4a48-90ea-75f910e59b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:40.237012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-1fc318e8-ab76-4a48-90ea-75f910e59b79 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:40.238250 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1fc318e8-ab76-4a48-90ea-75f910e59b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:40.314703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 421/853] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:40.339586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf26dc5-a0f0-4ad7-95dd-da068e209cd6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:40.437812 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05285-f135-4a73-95f0-10e53f8ddd4d None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:40.438168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05285-f135-4a73-95f0-10e53f8ddd4d None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:40.438371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05285-f135-4a73-95f0-10e53f8ddd4d None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:40.440152 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 422/854] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:02:40.445612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24f860-366d-4149-838f-9badbbe50c18 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:40.445928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24f860-366d-4149-838f-9badbbe50c18 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:40.446175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24f860-366d-4149-838f-9badbbe50c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:40.447670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:40.465052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-4f24f860-366d-4149-838f-9badbbe50c18 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:40.466273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4f24f860-366d-4149-838f-9badbbe50c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:40.467297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf26dc5-a0f0-4ad7-95dd-da068e209cd6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:40.508008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e494944-d86e-4cad-9ca1-0b028d6f080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:40.508923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494944-d86e-4cad-9ca1-0b028d6f080f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:40.509307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494944-d86e-4cad-9ca1-0b028d6f080f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:40.509592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494944-d86e-4cad-9ca1-0b028d6f080f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:40.520025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:40.521267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e494944-d86e-4cad-9ca1-0b028d6f080f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-3e494944-d86e-4cad-9ca1-0b028d6f080f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:40.530157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:40.533232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:40.534292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 433/855] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:02:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:40.537878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e494944-d86e-4cad-9ca1-0b028d6f080f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:40.561375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 423/856] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:40.584384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24f860-366d-4149-838f-9badbbe50c18 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:40.652754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e494944-d86e-4cad-9ca1-0b028d6f080f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:40.689436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00f239-00da-4914-9766-178cfe621c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:40.690220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f239-00da-4914-9766-178cfe621c50 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:40.690575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f239-00da-4914-9766-178cfe621c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:40.690928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f239-00da-4914-9766-178cfe621c50 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:40.691398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24f860-366d-4149-838f-9badbbe50c18 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:40.691825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00f239-00da-4914-9766-178cfe621c50 None admin] RBAC: Adding query filter params (name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:40.692246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00f239-00da-4914-9766-178cfe621c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:40.693887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00f239-00da-4914-9766-178cfe621c50 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:40.708562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 434/857] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:02:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:40.709596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00f239-00da-4914-9766-178cfe621c50 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:40.729143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9172e5-bc18-4d57-8805-aaa75ff57982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:40.730627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9172e5-bc18-4d57-8805-aaa75ff57982 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:40.730981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9172e5-bc18-4d57-8805-aaa75ff57982 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:40.731330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9172e5-bc18-4d57-8805-aaa75ff57982 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:40.732109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9172e5-bc18-4d57-8805-aaa75ff57982 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:40.733569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9172e5-bc18-4d57-8805-aaa75ff57982 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:40.744127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-ba9172e5-bc18-4d57-8805-aaa75ff57982 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:40.748594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:40.749883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:02:40.750686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:40.754288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 424/858] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Jun 2 13:02:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:40.761482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9172e5-bc18-4d57-8805-aaa75ff57982 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:40.817419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:40.834112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00f239-00da-4914-9766-178cfe621c50 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:40.877495 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0b588-d007-4aa7-95d7-6d680ac816e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:40.878283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b588-d007-4aa7-95d7-6d680ac816e3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:40.878517 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b588-d007-4aa7-95d7-6d680ac816e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:40.878799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b588-d007-4aa7-95d7-6d680ac816e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:40.895405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9172e5-bc18-4d57-8805-aaa75ff57982 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:40.895910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0b588-d007-4aa7-95d7-6d680ac816e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:40.898682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0b588-d007-4aa7-95d7-6d680ac816e3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-d2e0b588-d007-4aa7-95d7-6d680ac816e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:40.922554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:40.923500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:40.924415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:40.924415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:40.924415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:40.924415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:40.929859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 435/859] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:40.931595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0b588-d007-4aa7-95d7-6d680ac816e3 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:40.947285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fce9f5-1163-47e3-be48-34156c7580fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:40.947864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fce9f5-1163-47e3-be48-34156c7580fe None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:40.948275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fce9f5-1163-47e3-be48-34156c7580fe None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:40.948644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fce9f5-1163-47e3-be48-34156c7580fe None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:40.949515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fce9f5-1163-47e3-be48-34156c7580fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:40.949918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fce9f5-1163-47e3-be48-34156c7580fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:40.952652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fce9f5-1163-47e3-be48-34156c7580fe None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:40.966460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 425/860] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:40.969090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fce9f5-1163-47e3-be48-34156c7580fe None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:41.018201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:41.066926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0b588-d007-4aa7-95d7-6d680ac816e3 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:41.097280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fce9f5-1163-47e3-be48-34156c7580fe None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:41.099413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:41.112201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9b84-6a9e-44ff-b0d3-c52e41bd71e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:41.123771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9b84-6a9e-44ff-b0d3-c52e41bd71e3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:41.123771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9b84-6a9e-44ff-b0d3-c52e41bd71e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:41.123771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9b84-6a9e-44ff-b0d3-c52e41bd71e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:41.123771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9b84-6a9e-44ff-b0d3-c52e41bd71e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:41.123771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9b84-6a9e-44ff-b0d3-c52e41bd71e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:41.123771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9b84-6a9e-44ff-b0d3-c52e41bd71e3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:41.131572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 436/861] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:41.137240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9b84-6a9e-44ff-b0d3-c52e41bd71e3 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:41.141540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861498e-cae4-4e2e-8134-69de1308fdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:41.142733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861498e-cae4-4e2e-8134-69de1308fdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:41.143243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861498e-cae4-4e2e-8134-69de1308fdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:41.143736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861498e-cae4-4e2e-8134-69de1308fdc7 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:41.144795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861498e-cae4-4e2e-8134-69de1308fdc7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:41.145323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861498e-cae4-4e2e-8134-69de1308fdc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:41.147049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861498e-cae4-4e2e-8134-69de1308fdc7 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:41.160058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 426/862] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:41.269426 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9b84-6a9e-44ff-b0d3-c52e41bd71e3 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:41.296094 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:41.308530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6557a3-2f27-46ae-92b4-e871f77d0986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:41.312525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6557a3-2f27-46ae-92b4-e871f77d0986 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:41.312525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6557a3-2f27-46ae-92b4-e871f77d0986 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:41.312525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6557a3-2f27-46ae-92b4-e871f77d0986 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:41.318513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6557a3-2f27-46ae-92b4-e871f77d0986 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:41.320022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6557a3-2f27-46ae-92b4-e871f77d0986 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-cf6557a3-2f27-46ae-92b4-e871f77d0986 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:41.337645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:41.339503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:41.341369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:41.341369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:41.341369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:41.341369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:41.341369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:41.341369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:41.341369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:41.341369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:41.341369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:41.341369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:41.344194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 437/863] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Jun 2 13:02:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:41.346390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861498e-cae4-4e2e-8134-69de1308fdc7 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:41.476710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861498e-cae4-4e2e-8134-69de1308fdc7 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:41.514489 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab526c36-16c6-4242-83f5-1c4e0ac08cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:41.515179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526c36-16c6-4242-83f5-1c4e0ac08cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:41.515464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526c36-16c6-4242-83f5-1c4e0ac08cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:41.515743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526c36-16c6-4242-83f5-1c4e0ac08cb9 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:41.516631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab526c36-16c6-4242-83f5-1c4e0ac08cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:41.516943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab526c36-16c6-4242-83f5-1c4e0ac08cb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:41.518418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab526c36-16c6-4242-83f5-1c4e0ac08cb9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:41.538880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 427/864] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Jun 2 13:02:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:41.544551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6557a3-2f27-46ae-92b4-e871f77d0986 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:41.653212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6557a3-2f27-46ae-92b4-e871f77d0986 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:41.689548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe6bee-2a92-4cba-b31f-589386744c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:41.690209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe6bee-2a92-4cba-b31f-589386744c18 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:41.690543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe6bee-2a92-4cba-b31f-589386744c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:41.690831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe6bee-2a92-4cba-b31f-589386744c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:41.748087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:41.750081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c05ed-e662-4bfc-9456-3438cfcd09f4 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:41.750551 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c05ed-e662-4bfc-9456-3438cfcd09f4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:41.750637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c05ed-e662-4bfc-9456-3438cfcd09f4 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:41.752486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 428/865] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:02:41.758288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55875-2177-49d3-8ed1-eec07463633e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:41.758804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55875-2177-49d3-8ed1-eec07463633e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:41.759166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55875-2177-49d3-8ed1-eec07463633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:41.769153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe6bee-2a92-4cba-b31f-589386744c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:41.770935 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe6bee-2a92-4cba-b31f-589386744c18 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:41.783166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-6de55875-2177-49d3-8ed1-eec07463633e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:41.784533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6de55875-2177-49d3-8ed1-eec07463633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:41.810839 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:41.884045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 429/866] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:41.895074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 438/867] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:02:41.903825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55875-2177-49d3-8ed1-eec07463633e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:41.910501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe6bee-2a92-4cba-b31f-589386744c18 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:42.010036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:42.029151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55875-2177-49d3-8ed1-eec07463633e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:42.041538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe6bee-2a92-4cba-b31f-589386744c18 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:42.090319 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ca1c-a879-4fe1-9af1-cf8ed71790d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:42.091999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ca1c-a879-4fe1-9af1-cf8ed71790d9 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:42.092925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ca1c-a879-4fe1-9af1-cf8ed71790d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:42.093084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838edd7f-8dfb-4cf0-8d5c-6001ba377069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:42.093880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838edd7f-8dfb-4cf0-8d5c-6001ba377069 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:42.094174 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838edd7f-8dfb-4cf0-8d5c-6001ba377069 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:42.094456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838edd7f-8dfb-4cf0-8d5c-6001ba377069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:42.094622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20ca1c-a879-4fe1-9af1-cf8ed71790d9 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:42.096762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ca1c-a879-4fe1-9af1-cf8ed71790d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:42.100216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20ca1c-a879-4fe1-9af1-cf8ed71790d9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:42.106893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838edd7f-8dfb-4cf0-8d5c-6001ba377069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:42.108543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838edd7f-8dfb-4cf0-8d5c-6001ba377069 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-838edd7f-8dfb-4cf0-8d5c-6001ba377069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:42.128066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:42.129035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:42.129959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:42.129959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:42.129959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:42.129959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:42.130862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 430/868] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:42.135014 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838edd7f-8dfb-4cf0-8d5c-6001ba377069 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:42.144634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:42.198684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 439/869] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:02:41 2022] POST /identity/v3/services => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:02:42.261277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838edd7f-8dfb-4cf0-8d5c-6001ba377069 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:42.312458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8f984-2ef0-451d-9e9f-e443e5d4d686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:42.313547 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f984-2ef0-451d-9e9f-e443e5d4d686 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:42.314054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f984-2ef0-451d-9e9f-e443e5d4d686 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:42.314579 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f984-2ef0-451d-9e9f-e443e5d4d686 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:42.315551 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8f984-2ef0-451d-9e9f-e443e5d4d686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:42.316126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8f984-2ef0-451d-9e9f-e443e5d4d686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:42.317788 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8f984-2ef0-451d-9e9f-e443e5d4d686 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:42.332458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 431/870] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:42.339226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ca1c-a879-4fe1-9af1-cf8ed71790d9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:42.458442 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20ca1c-a879-4fe1-9af1-cf8ed71790d9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:42.496195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e4429-8a73-4855-ab80-f1746140cef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:42.497011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e4429-8a73-4855-ab80-f1746140cef6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:42.497293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e4429-8a73-4855-ab80-f1746140cef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:42.497565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e4429-8a73-4855-ab80-f1746140cef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:42.505195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e4429-8a73-4855-ab80-f1746140cef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:42.506860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e4429-8a73-4855-ab80-f1746140cef6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-108e4429-8a73-4855-ab80-f1746140cef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:42.522339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:42.523303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:42.524706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:42.524706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:42.524706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:42.524706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:42.524706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:42.524706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:42.524706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:42.524706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:42.524706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 440/871] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:42.530185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8f984-2ef0-451d-9e9f-e443e5d4d686 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:42.577565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd35b4-5525-457a-8988-a724d293d86f None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:42.577917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd35b4-5525-457a-8988-a724d293d86f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:42.578127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd35b4-5525-457a-8988-a724d293d86f None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:42.579773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 441/872] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:02:42.585233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb3499-333d-4be2-a5c6-66b1d9c074c1 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:42.585515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb3499-333d-4be2-a5c6-66b1d9c074c1 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:42.585799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb3499-333d-4be2-a5c6-66b1d9c074c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:42.599854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:42.602718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:42.608466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-11cb3499-333d-4be2-a5c6-66b1d9c074c1 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:42.609764 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-11cb3499-333d-4be2-a5c6-66b1d9c074c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:42.638783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8f984-2ef0-451d-9e9f-e443e5d4d686 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:42.681884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75165345-c40f-4e77-83a5-e01f2c331715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:42.683426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165345-c40f-4e77-83a5-e01f2c331715 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:42.683947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165345-c40f-4e77-83a5-e01f2c331715 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:42.684465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165345-c40f-4e77-83a5-e01f2c331715 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:42.685598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75165345-c40f-4e77-83a5-e01f2c331715 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:42.686106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75165345-c40f-4e77-83a5-e01f2c331715 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:42.687765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75165345-c40f-4e77-83a5-e01f2c331715 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:42.707908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 442/873] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:42.708567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 432/874] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:42.712799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb3499-333d-4be2-a5c6-66b1d9c074c1 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:42.729337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75165345-c40f-4e77-83a5-e01f2c331715 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:42.846950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb3499-333d-4be2-a5c6-66b1d9c074c1 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:42.865158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75165345-c40f-4e77-83a5-e01f2c331715 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:42.885090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:42.892257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34360eb2-119b-4b67-8358-326f319c7b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:42.892933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34360eb2-119b-4b67-8358-326f319c7b01 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:42.893220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34360eb2-119b-4b67-8358-326f319c7b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:42.893495 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34360eb2-119b-4b67-8358-326f319c7b01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:42.894359 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34360eb2-119b-4b67-8358-326f319c7b01 None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=4683d277112848ce9b49db3b15aaa32c) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:42.895143 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34360eb2-119b-4b67-8358-326f319c7b01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:42.896949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34360eb2-119b-4b67-8358-326f319c7b01 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:42.900590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:42.912285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 443/875] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:42 2022] GET /identity/v3/role_assignments?user.id=4683d277112848ce9b49db3b15aaa32c&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:42.915751 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b42f85-8643-45b4-bc8f-d7864b49b574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:42.916946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b42f85-8643-45b4-bc8f-d7864b49b574 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:42.917377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b42f85-8643-45b4-bc8f-d7864b49b574 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:42.917884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b42f85-8643-45b4-bc8f-d7864b49b574 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:42.918782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b42f85-8643-45b4-bc8f-d7864b49b574 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:42.920558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b42f85-8643-45b4-bc8f-d7864b49b574 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-b6b42f85-8643-45b4-bc8f-d7864b49b574 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:42.935634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:42.945243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:42.946109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 433/876] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:42.946918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34360eb2-119b-4b67-8358-326f319c7b01 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:43.070345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34360eb2-119b-4b67-8358-326f319c7b01 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:43.110459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19706426-0e4f-48af-9b76-6c8ca396b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:43.111147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19706426-0e4f-48af-9b76-6c8ca396b6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:43.111429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19706426-0e4f-48af-9b76-6c8ca396b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:43.111704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19706426-0e4f-48af-9b76-6c8ca396b6c5 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:43.112534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19706426-0e4f-48af-9b76-6c8ca396b6c5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:43.112839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19706426-0e4f-48af-9b76-6c8ca396b6c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:43.114528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19706426-0e4f-48af-9b76-6c8ca396b6c5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:43.121109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 444/877] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Jun 2 13:02:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:43.126719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b42f85-8643-45b4-bc8f-d7864b49b574 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:43.238957 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b42f85-8643-45b4-bc8f-d7864b49b574 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:43.284446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37180884-d955-40f8-a3b0-f3cb397653ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:43.285461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37180884-d955-40f8-a3b0-f3cb397653ed None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:43.285930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37180884-d955-40f8-a3b0-f3cb397653ed None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:43.286413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37180884-d955-40f8-a3b0-f3cb397653ed None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:43.287302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37180884-d955-40f8-a3b0-f3cb397653ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:43.287781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37180884-d955-40f8-a3b0-f3cb397653ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:43.289348 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37180884-d955-40f8-a3b0-f3cb397653ed None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:43.295019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 434/878] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Jun 2 13:02:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:43.591693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0cd79-f031-42e3-ac1c-cb4aa55b4764 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:43.592096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0cd79-f031-42e3-ac1c-cb4aa55b4764 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:43.592276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0cd79-f031-42e3-ac1c-cb4aa55b4764 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:43.593881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 445/879] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:43.599819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bad6e8-7a97-425f-9dd1-055e53b82dc7 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:43.600410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bad6e8-7a97-425f-9dd1-055e53b82dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:43.600863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bad6e8-7a97-425f-9dd1-055e53b82dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:43.621037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-09bad6e8-7a97-425f-9dd1-055e53b82dc7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:43.622665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-09bad6e8-7a97-425f-9dd1-055e53b82dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:43.672538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:43.694180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 435/880] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:43 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:43.717128 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0cd79-f031-42e3-ac1c-cb4aa55b4764 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:43.787209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:43.832265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0cd79-f031-42e3-ac1c-cb4aa55b4764 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:43.870545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd8630-635d-4aff-a20c-71beb82d14bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:43.871221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd8630-635d-4aff-a20c-71beb82d14bf None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:43.871506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd8630-635d-4aff-a20c-71beb82d14bf None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:43.871847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd8630-635d-4aff-a20c-71beb82d14bf None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:43.872632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd8630-635d-4aff-a20c-71beb82d14bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:43.874047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd8630-635d-4aff-a20c-71beb82d14bf None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:43.976665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 446/881] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:02:43 2022] POST /identity/v3/services => generated 269 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:02:44.741472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd3d79-44da-4ffb-880c-8601286153a4 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:44.741979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd3d79-44da-4ffb-880c-8601286153a4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:44.741979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd3d79-44da-4ffb-880c-8601286153a4 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:44.743649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 436/882] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:44.749859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fdc09-8fe8-42a5-ab84-82c8aec3d83d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:44.750799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fdc09-8fe8-42a5-ab84-82c8aec3d83d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:44.751292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fdc09-8fe8-42a5-ab84-82c8aec3d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:44.769314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-df5fdc09-8fe8-42a5-ab84-82c8aec3d83d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:44.770859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-df5fdc09-8fe8-42a5-ab84-82c8aec3d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:44.855978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 447/883] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:44.874367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd3d79-44da-4ffb-880c-8601286153a4 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:44.985564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd3d79-44da-4ffb-880c-8601286153a4 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:45.026798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20f0e2-a3ea-4f8d-a519-2a34a7df2ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:45.027644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20f0e2-a3ea-4f8d-a519-2a34a7df2ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.027957 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20f0e2-a3ea-4f8d-a519-2a34a7df2ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.028237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20f0e2-a3ea-4f8d-a519-2a34a7df2ab5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.028915 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20f0e2-a3ea-4f8d-a519-2a34a7df2ab5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:45.030354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20f0e2-a3ea-4f8d-a519-2a34a7df2ab5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-ac20f0e2-a3ea-4f8d-a519-2a34a7df2ab5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:45.043935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:45.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:02:45.045829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:45.050238 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 437/884] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:02:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:45.051642 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fdc09-8fe8-42a5-ab84-82c8aec3d83d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:45.102508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:45.167240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fdc09-8fe8-42a5-ab84-82c8aec3d83d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:45.204564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb66781-f7f4-4067-a771-8b1614877b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:45.205247 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb66781-f7f4-4067-a771-8b1614877b0a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.205535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb66781-f7f4-4067-a771-8b1614877b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.205814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb66781-f7f4-4067-a771-8b1614877b0a None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.206535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb66781-f7f4-4067-a771-8b1614877b0a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:45.206843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb66781-f7f4-4067-a771-8b1614877b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:45.208251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb66781-f7f4-4067-a771-8b1614877b0a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:45.218419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 448/885] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:02:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:45.219804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20f0e2-a3ea-4f8d-a519-2a34a7df2ab5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:45.271692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:45.336326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20f0e2-a3ea-4f8d-a519-2a34a7df2ab5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:45.355328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f0d39-77f7-4d23-8eba-ed0cbc45d9ed None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.356028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f0d39-77f7-4d23-8eba-ed0cbc45d9ed None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.356516 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f0d39-77f7-4d23-8eba-ed0cbc45d9ed None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.358363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 449/886] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:02:45.363786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69552e28-8997-4654-9b90-1f97b1654447 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.364648 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69552e28-8997-4654-9b90-1f97b1654447 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.365137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69552e28-8997-4654-9b90-1f97b1654447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.374829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8bbd6-6164-4639-9b69-7cd46ec92d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:45.375850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8bbd6-6164-4639-9b69-7cd46ec92d73 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.376403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8bbd6-6164-4639-9b69-7cd46ec92d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.380698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8bbd6-6164-4639-9b69-7cd46ec92d73 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.381089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8bbd6-6164-4639-9b69-7cd46ec92d73 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:45.381407 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8bbd6-6164-4639-9b69-7cd46ec92d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:45.382837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8bbd6-6164-4639-9b69-7cd46ec92d73 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:45.393348 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 438/887] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:02:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:45.396979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-69552e28-8997-4654-9b90-1f97b1654447 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:45.398990 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-69552e28-8997-4654-9b90-1f97b1654447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:45.409000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8bbd6-6164-4639-9b69-7cd46ec92d73 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:45.487811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 450/888] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:45.518552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69552e28-8997-4654-9b90-1f97b1654447 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:45.535808 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8bbd6-6164-4639-9b69-7cd46ec92d73 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:45.547361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:45.571261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:45.585383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3b2fd-1ee6-4f98-936c-7323e524e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:45.586101 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3b2fd-1ee6-4f98-936c-7323e524e688 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.586444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3b2fd-1ee6-4f98-936c-7323e524e688 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.586671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3b2fd-1ee6-4f98-936c-7323e524e688 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.587648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3b2fd-1ee6-4f98-936c-7323e524e688 None admin] RBAC: Adding query filter params (interface=public, service_id=1fb1bdbbae20450e896709c5931a6206, region_id=RegionOne) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:45.587982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3b2fd-1ee6-4f98-936c-7323e524e688 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:45.590572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3b2fd-1ee6-4f98-936c-7323e524e688 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:45.599961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 439/889] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Jun 2 13:02:45 2022] GET /identity/v3/endpoints?service_id=1fb1bdbbae20450e896709c5931a6206&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:45.605354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3b2fd-1ee6-4f98-936c-7323e524e688 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:45.641526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69552e28-8997-4654-9b90-1f97b1654447 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:45.680878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144818f-bcf0-48a3-ac69-4ad077a8d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:45.681867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144818f-bcf0-48a3-ac69-4ad077a8d16b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.682939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144818f-bcf0-48a3-ac69-4ad077a8d16b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.683231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144818f-bcf0-48a3-ac69-4ad077a8d16b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.696925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144818f-bcf0-48a3-ac69-4ad077a8d16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-c144818f-bcf0-48a3-ac69-4ad077a8d16b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:45.706486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:45.707489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:45.708373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 451/890] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Jun 2 13:02:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:45.709563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2373dc-3ce5-45d6-8622-fdfc7caa9b68 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.709563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2373dc-3ce5-45d6-8622-fdfc7caa9b68 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.709800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2373dc-3ce5-45d6-8622-fdfc7caa9b68 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.711185 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 452/891] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:45.716821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2373dc-3ce5-45d6-8622-fdfc7caa9b68 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:45.722701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3b2fd-1ee6-4f98-936c-7323e524e688 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:45.767456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832474-9987-4bcc-803d-94d9dccbc00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:45.768257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832474-9987-4bcc-803d-94d9dccbc00a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.768610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832474-9987-4bcc-803d-94d9dccbc00a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.768894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832474-9987-4bcc-803d-94d9dccbc00a None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.769577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832474-9987-4bcc-803d-94d9dccbc00a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:45.770950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832474-9987-4bcc-803d-94d9dccbc00a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:45.777912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 440/892] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Jun 2 13:02:45 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:02:45.779201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864df06-4341-418a-b9d9-866bfbaa7133 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.779488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864df06-4341-418a-b9d9-866bfbaa7133 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.779762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864df06-4341-418a-b9d9-866bfbaa7133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.798449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-1864df06-4341-418a-b9d9-866bfbaa7133 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:45.800126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1864df06-4341-418a-b9d9-866bfbaa7133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:45.845032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:45.857980 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:45.863275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2373dc-3ce5-45d6-8622-fdfc7caa9b68 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:45.906996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bdad1-4c70-40cc-b3f2-69043b1ca3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:45.907825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bdad1-4c70-40cc-b3f2-69043b1ca3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:45.908128 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bdad1-4c70-40cc-b3f2-69043b1ca3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:45.908403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bdad1-4c70-40cc-b3f2-69043b1ca3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:45.909228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bdad1-4c70-40cc-b3f2-69043b1ca3d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:45.909531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bdad1-4c70-40cc-b3f2-69043b1ca3d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:45.911215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bdad1-4c70-40cc-b3f2-69043b1ca3d6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:45.926463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 453/893] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Jun 2 13:02:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:45.929035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bdad1-4c70-40cc-b3f2-69043b1ca3d6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:45.934307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 441/894] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:45.958330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864df06-4341-418a-b9d9-866bfbaa7133 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:46.066014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bdad1-4c70-40cc-b3f2-69043b1ca3d6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:46.079659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864df06-4341-418a-b9d9-866bfbaa7133 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:46.107529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410a3f2-2799-46da-aee1-73e1ddbf445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:46.108724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410a3f2-2799-46da-aee1-73e1ddbf445d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.109009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410a3f2-2799-46da-aee1-73e1ddbf445d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.109283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410a3f2-2799-46da-aee1-73e1ddbf445d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.123753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410a3f2-2799-46da-aee1-73e1ddbf445d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:46.125046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27a7f4-0045-4d9a-8159-b4186f3ed78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:46.125301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410a3f2-2799-46da-aee1-73e1ddbf445d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:46.126332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27a7f4-0045-4d9a-8159-b4186f3ed78b None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.126831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27a7f4-0045-4d9a-8159-b4186f3ed78b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.127315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27a7f4-0045-4d9a-8159-b4186f3ed78b None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.128259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27a7f4-0045-4d9a-8159-b4186f3ed78b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:46.129822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27a7f4-0045-4d9a-8159-b4186f3ed78b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-e410a3f2-2799-46da-aee1-73e1ddbf445d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:46.144766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:46.146310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:46.147182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:46.147182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:46.147182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:46.147182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:46.147182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 454/895] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:46.151704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410a3f2-2799-46da-aee1-73e1ddbf445d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:46.169201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:46.208987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 442/896] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:02:45 2022] POST /identity/v3/services => generated 241 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:02:46.277518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410a3f2-2799-46da-aee1-73e1ddbf445d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:46.295061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd598-cdf0-4e4a-b0d5-4ff1989049ea None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.295418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd598-cdf0-4e4a-b0d5-4ff1989049ea None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.295631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd598-cdf0-4e4a-b0d5-4ff1989049ea None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.297285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 443/897] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:46.304028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a4a9-cca6-4e40-9f67-5e267d6b5e92 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.304373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a4a9-cca6-4e40-9f67-5e267d6b5e92 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.304586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a4a9-cca6-4e40-9f67-5e267d6b5e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.325324 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-5f84a4a9-cca6-4e40-9f67-5e267d6b5e92 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:46.326682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5f84a4a9-cca6-4e40-9f67-5e267d6b5e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:46.327104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f3d28-0760-4f59-aa06-1adf7e2a7b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:46.328102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f3d28-0760-4f59-aa06-1adf7e2a7b14 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.328609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f3d28-0760-4f59-aa06-1adf7e2a7b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.329106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f3d28-0760-4f59-aa06-1adf7e2a7b14 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.330044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f3d28-0760-4f59-aa06-1adf7e2a7b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:46.330564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f3d28-0760-4f59-aa06-1adf7e2a7b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:46.332223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f3d28-0760-4f59-aa06-1adf7e2a7b14 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:46.346141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 455/898] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:46.351036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:46.353819 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f3d28-0760-4f59-aa06-1adf7e2a7b14 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:46.423052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 444/899] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:46.446732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a4a9-cca6-4e40-9f67-5e267d6b5e92 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:46.461208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:46.501085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f3d28-0760-4f59-aa06-1adf7e2a7b14 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:46.537712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134e962-28e8-4206-bc2e-014606e681b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:46.538535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e962-28e8-4206-bc2e-014606e681b5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.538817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e962-28e8-4206-bc2e-014606e681b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.539106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e962-28e8-4206-bc2e-014606e681b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.547691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134e962-28e8-4206-bc2e-014606e681b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:46.549177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134e962-28e8-4206-bc2e-014606e681b5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-1134e962-28e8-4206-bc2e-014606e681b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:46.566565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:46.567598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:46.568993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 456/900] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Jun 2 13:02:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:46.576908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134e962-28e8-4206-bc2e-014606e681b5 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:46.586840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a4a9-cca6-4e40-9f67-5e267d6b5e92 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:46.630592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4866b1-490a-4941-a9dc-01b6034188c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:46.631606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4866b1-490a-4941-a9dc-01b6034188c9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.631897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4866b1-490a-4941-a9dc-01b6034188c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.632314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4866b1-490a-4941-a9dc-01b6034188c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.633045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4866b1-490a-4941-a9dc-01b6034188c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:46.634518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4866b1-490a-4941-a9dc-01b6034188c9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-6e4866b1-490a-4941-a9dc-01b6034188c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:46.647496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:46.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:46.649795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 445/901] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Jun 2 13:02:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:46.655119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4866b1-490a-4941-a9dc-01b6034188c9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:46.686706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:46.700154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134e962-28e8-4206-bc2e-014606e681b5 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:46.736165 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:46.743293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20455b1a-c8e4-4d22-aa85-758de5045886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:46.744463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20455b1a-c8e4-4d22-aa85-758de5045886 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.744944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20455b1a-c8e4-4d22-aa85-758de5045886 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.745389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20455b1a-c8e4-4d22-aa85-758de5045886 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.746398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20455b1a-c8e4-4d22-aa85-758de5045886 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:46.746953 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20455b1a-c8e4-4d22-aa85-758de5045886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:46.748740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20455b1a-c8e4-4d22-aa85-758de5045886 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:46.769959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 457/902] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Jun 2 13:02:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:46.778464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20455b1a-c8e4-4d22-aa85-758de5045886 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:46.781335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4866b1-490a-4941-a9dc-01b6034188c9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:46.818573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced279-66a0-48ac-87c1-59d42e730998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:46.819377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced279-66a0-48ac-87c1-59d42e730998 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.819726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced279-66a0-48ac-87c1-59d42e730998 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.820189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edced279-66a0-48ac-87c1-59d42e730998 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.821075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edced279-66a0-48ac-87c1-59d42e730998 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:46.821450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edced279-66a0-48ac-87c1-59d42e730998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:46.823634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edced279-66a0-48ac-87c1-59d42e730998 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:46.829286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 446/903] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:46.834881 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced279-66a0-48ac-87c1-59d42e730998 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:46.898574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20455b1a-c8e4-4d22-aa85-758de5045886 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:46.939394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:46.943504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e79f9-9155-42eb-bd2d-f676f6358925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:46.944810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e79f9-9155-42eb-bd2d-f676f6358925 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.945549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e79f9-9155-42eb-bd2d-f676f6358925 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.946043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e79f9-9155-42eb-bd2d-f676f6358925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.957034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edced279-66a0-48ac-87c1-59d42e730998 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:46.993797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a79f7-5e29-43c0-998d-4d263894739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:46.994546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a79f7-5e29-43c0-998d-4d263894739c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:46.995332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a79f7-5e29-43c0-998d-4d263894739c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:46.995639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a79f7-5e29-43c0-998d-4d263894739c None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:46.996347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a79f7-5e29-43c0-998d-4d263894739c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:46.996662 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a79f7-5e29-43c0-998d-4d263894739c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:46.998132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a79f7-5e29-43c0-998d-4d263894739c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:47.008316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 447/904] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:47.009212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:47.011729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a79f7-5e29-43c0-998d-4d263894739c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:47.023912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e79f9-9155-42eb-bd2d-f676f6358925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:47.025410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e79f9-9155-42eb-bd2d-f676f6358925 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:47.123008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a79f7-5e29-43c0-998d-4d263894739c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:47.138553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 458/905] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:46 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:02:47.139503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e79f9-9155-42eb-bd2d-f676f6358925 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:47.161568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1e4b-fdd9-4e1d-ad03-2b7766a12dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:47.162549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1e4b-fdd9-4e1d-ad03-2b7766a12dfc None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:47.162992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1e4b-fdd9-4e1d-ad03-2b7766a12dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:47.163413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1e4b-fdd9-4e1d-ad03-2b7766a12dfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:47.164420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df1e4b-fdd9-4e1d-ad03-2b7766a12dfc None admin] RBAC: Adding query filter params (interface=public, service_id=009aa8a49a61400c80b376be866bced4, region_id=RegionOne) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:47.164958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df1e4b-fdd9-4e1d-ad03-2b7766a12dfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:47.166649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df1e4b-fdd9-4e1d-ad03-2b7766a12dfc None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:47.173227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 448/906] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Jun 2 13:02:47 2022] GET /identity/v3/endpoints?service_id=009aa8a49a61400c80b376be866bced4&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:47.178912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1e4b-fdd9-4e1d-ad03-2b7766a12dfc None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:47.196175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:47.232947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:47.245984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e79f9-9155-42eb-bd2d-f676f6358925 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:47.281660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9630e0-a2c8-46aa-a9e3-4e7bf132477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:47.283035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9630e0-a2c8-46aa-a9e3-4e7bf132477d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:47.283327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9630e0-a2c8-46aa-a9e3-4e7bf132477d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:47.283609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9630e0-a2c8-46aa-a9e3-4e7bf132477d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:47.291165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1e4b-fdd9-4e1d-ad03-2b7766a12dfc None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:47.297497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9630e0-a2c8-46aa-a9e3-4e7bf132477d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:47.298989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9630e0-a2c8-46aa-a9e3-4e7bf132477d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-2d9630e0-a2c8-46aa-a9e3-4e7bf132477d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:47.322601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:47.323736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:47.324699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:47.324699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:47.324699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:47.324699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:47.328039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 459/907] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:47.330854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9630e0-a2c8-46aa-a9e3-4e7bf132477d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:47.341003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bf63f-053d-4a89-a930-d8d0461c4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:47.341997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bf63f-053d-4a89-a930-d8d0461c4a2d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:47.342836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bf63f-053d-4a89-a930-d8d0461c4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:47.343362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bf63f-053d-4a89-a930-d8d0461c4a2d None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:47.344659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bf63f-053d-4a89-a930-d8d0461c4a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:47.346639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bf63f-053d-4a89-a930-d8d0461c4a2d None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:47.355650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 449/908] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Jun 2 13:02:47 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:02:47.448183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9630e0-a2c8-46aa-a9e3-4e7bf132477d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:47.489125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d80f-94f9-40fc-992a-a575f97e49a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:47.489835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d80f-94f9-40fc-992a-a575f97e49a0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:47.490119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d80f-94f9-40fc-992a-a575f97e49a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:47.490398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d80f-94f9-40fc-992a-a575f97e49a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:47.491162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127d80f-94f9-40fc-992a-a575f97e49a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:47.491470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127d80f-94f9-40fc-992a-a575f97e49a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:47.492942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127d80f-94f9-40fc-992a-a575f97e49a0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:47.506762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 460/909] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:47.507411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:47.512523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bf63f-053d-4a89-a930-d8d0461c4a2d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:47.602898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:47.627268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bf63f-053d-4a89-a930-d8d0461c4a2d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:47.663183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a072a6-4239-42b3-9a4c-bb38a88cb7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:47.664023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a072a6-4239-42b3-9a4c-bb38a88cb7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:47.664308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a072a6-4239-42b3-9a4c-bb38a88cb7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:47.664582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a072a6-4239-42b3-9a4c-bb38a88cb7d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:47.672574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a072a6-4239-42b3-9a4c-bb38a88cb7d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:47.674042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a072a6-4239-42b3-9a4c-bb38a88cb7d4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-a2a072a6-4239-42b3-9a4c-bb38a88cb7d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:47.689236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:47.690176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:47.691094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:47.691094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:47.691094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:47.691094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:47.691094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:47.691094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:47.691094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:47.691094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:47.691094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 450/910] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:47.696561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d80f-94f9-40fc-992a-a575f97e49a0 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:47.804478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d80f-94f9-40fc-992a-a575f97e49a0 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:47.839808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba421f65-2df6-48e0-969b-012f7878c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:47.840523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba421f65-2df6-48e0-969b-012f7878c94d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:47.840805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba421f65-2df6-48e0-969b-012f7878c94d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:47.841079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba421f65-2df6-48e0-969b-012f7878c94d None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:47.841879 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba421f65-2df6-48e0-969b-012f7878c94d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:47.842191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba421f65-2df6-48e0-969b-012f7878c94d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:47.843681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba421f65-2df6-48e0-969b-012f7878c94d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:47.857621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 461/911] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:47.863556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a072a6-4239-42b3-9a4c-bb38a88cb7d4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:47.973274 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a072a6-4239-42b3-9a4c-bb38a88cb7d4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:48.009616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dc048-4f86-4238-ba4b-9e086303a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:48.010825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc048-4f86-4238-ba4b-9e086303a3da None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:48.011109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc048-4f86-4238-ba4b-9e086303a3da None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:48.011382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc048-4f86-4238-ba4b-9e086303a3da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:48.012300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dc048-4f86-4238-ba4b-9e086303a3da None admin] RBAC: Adding query filter params (role.id=545468338c4445a78e84a2ad0660817c, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=4683d277112848ce9b49db3b15aaa32c) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:48.012616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dc048-4f86-4238-ba4b-9e086303a3da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:48.014054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dc048-4f86-4238-ba4b-9e086303a3da None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:48.020199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:48.020455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 451/912] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:47 2022] GET /identity/v3/role_assignments?user.id=4683d277112848ce9b49db3b15aaa32c&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=545468338c4445a78e84a2ad0660817c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:48.250157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae91da-d3ea-4407-8d6c-d699813288b5 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:48.250716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae91da-d3ea-4407-8d6c-d699813288b5 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:48.250716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae91da-d3ea-4407-8d6c-d699813288b5 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:48.252257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 462/913] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:48.258040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38720f-18c9-420f-a3ae-0702a8f2ebb7 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:48.258607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38720f-18c9-420f-a3ae-0702a8f2ebb7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:48.259085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38720f-18c9-420f-a3ae-0702a8f2ebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:48.277469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-bd38720f-18c9-420f-a3ae-0702a8f2ebb7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:48.279001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bd38720f-18c9-420f-a3ae-0702a8f2ebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:48.356450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 452/914] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:48.380143 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae91da-d3ea-4407-8d6c-d699813288b5 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:48.443775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:48.487825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae91da-d3ea-4407-8d6c-d699813288b5 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:48.526068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146f014-43b9-4b77-80af-94dd02d0b371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:48.526800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146f014-43b9-4b77-80af-94dd02d0b371 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:48.527081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146f014-43b9-4b77-80af-94dd02d0b371 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:48.527354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146f014-43b9-4b77-80af-94dd02d0b371 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:48.528045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146f014-43b9-4b77-80af-94dd02d0b371 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:48.529425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146f014-43b9-4b77-80af-94dd02d0b371 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-f146f014-43b9-4b77-80af-94dd02d0b371 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:48.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:48.543014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:48.543834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 463/915] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:02:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:48.550772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38720f-18c9-420f-a3ae-0702a8f2ebb7 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:48.656949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38720f-18c9-420f-a3ae-0702a8f2ebb7 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:48.690982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:48.693358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dc3b6-9226-4fd7-9326-5738f4b2a18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:48.694041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dc3b6-9226-4fd7-9326-5738f4b2a18e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:48.694327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dc3b6-9226-4fd7-9326-5738f4b2a18e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:48.694670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dc3b6-9226-4fd7-9326-5738f4b2a18e None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:48.695396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dc3b6-9226-4fd7-9326-5738f4b2a18e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:48.695704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dc3b6-9226-4fd7-9326-5738f4b2a18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:48.697112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dc3b6-9226-4fd7-9326-5738f4b2a18e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:48.702891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b44f6-c63d-44a9-b916-beea93853831 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:48.702891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b44f6-c63d-44a9-b916-beea93853831 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:48.702891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b44f6-c63d-44a9-b916-beea93853831 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:48.703490 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 453/916] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:02:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:48.703784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 464/917] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:48.709269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54123c-8049-449b-8317-9e95ace929c4 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:48.709559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54123c-8049-449b-8317-9e95ace929c4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:48.709847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54123c-8049-449b-8317-9e95ace929c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:48.710016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b44f6-c63d-44a9-b916-beea93853831 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:48.731322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-7f54123c-8049-449b-8317-9e95ace929c4 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:48.732902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7f54123c-8049-449b-8317-9e95ace929c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:48.821586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 454/918] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:48.841136 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b44f6-c63d-44a9-b916-beea93853831 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:48.844639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54123c-8049-449b-8317-9e95ace929c4 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:48.875969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:48.889991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c482868-6d7e-4002-b487-5d6092a3f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:48.890952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c482868-6d7e-4002-b487-5d6092a3f38a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:48.891439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c482868-6d7e-4002-b487-5d6092a3f38a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:48.891940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c482868-6d7e-4002-b487-5d6092a3f38a None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:48.892894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c482868-6d7e-4002-b487-5d6092a3f38a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:48.893411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c482868-6d7e-4002-b487-5d6092a3f38a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:48.895041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c482868-6d7e-4002-b487-5d6092a3f38a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:48.900659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 465/919] 10.222.0.46 () {56 vars in 1114 bytes} [Thu Jun 2 13:02:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:48.906275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c482868-6d7e-4002-b487-5d6092a3f38a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:48.967794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54123c-8049-449b-8317-9e95ace929c4 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:48.992924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:49.004492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffcdc-ab3d-4a42-9c3f-a5460cdc0b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:49.005218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffcdc-ab3d-4a42-9c3f-a5460cdc0b5c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:49.005620 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffcdc-ab3d-4a42-9c3f-a5460cdc0b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:49.006023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffcdc-ab3d-4a42-9c3f-a5460cdc0b5c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:49.006773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ffcdc-ab3d-4a42-9c3f-a5460cdc0b5c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:49.008264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ffcdc-ab3d-4a42-9c3f-a5460cdc0b5c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:49.017921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c482868-6d7e-4002-b487-5d6092a3f38a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-2d7ffcdc-ab3d-4a42-9c3f-a5460cdc0b5c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:49.021589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:49.022754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:49.023775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:49.031310 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 455/920] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:49.032305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffcdc-ab3d-4a42-9c3f-a5460cdc0b5c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:49.059960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb65d0-0a7f-4b0c-9d7f-badae5d5cd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:49.060870 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb65d0-0a7f-4b0c-9d7f-badae5d5cd0c None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:49.061299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb65d0-0a7f-4b0c-9d7f-badae5d5cd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:49.061816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb65d0-0a7f-4b0c-9d7f-badae5d5cd0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:49.062805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb65d0-0a7f-4b0c-9d7f-badae5d5cd0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:49.064355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb65d0-0a7f-4b0c-9d7f-badae5d5cd0c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:49.137276 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffcdc-ab3d-4a42-9c3f-a5460cdc0b5c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:49.148269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 466/921] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Jun 2 13:02:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:02:49.187781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389a8d5-5def-4976-9a92-8b908e12bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:49.188512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389a8d5-5def-4976-9a92-8b908e12bbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:49.188849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389a8d5-5def-4976-9a92-8b908e12bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:49.189133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389a8d5-5def-4976-9a92-8b908e12bbf3 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:49.189948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389a8d5-5def-4976-9a92-8b908e12bbf3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:49.190271 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389a8d5-5def-4976-9a92-8b908e12bbf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:49.191788 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389a8d5-5def-4976-9a92-8b908e12bbf3 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:49.198231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 456/922] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Jun 2 13:02:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:49.204292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb65d0-0a7f-4b0c-9d7f-badae5d5cd0c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:49.255941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:49.317292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb65d0-0a7f-4b0c-9d7f-badae5d5cd0c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:49.356424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73821757-3ad0-4c59-a878-21052a32f1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:49.357117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73821757-3ad0-4c59-a878-21052a32f1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:49.357400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73821757-3ad0-4c59-a878-21052a32f1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:49.357681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73821757-3ad0-4c59-a878-21052a32f1c0 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:49.358406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73821757-3ad0-4c59-a878-21052a32f1c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:49.358715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73821757-3ad0-4c59-a878-21052a32f1c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:49.360133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73821757-3ad0-4c59-a878-21052a32f1c0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:49.366507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 467/923] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Jun 2 13:02:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:49.372472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389a8d5-5def-4976-9a92-8b908e12bbf3 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:49.425557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:49.486122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389a8d5-5def-4976-9a92-8b908e12bbf3 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:49.521249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5aacf-3512-4007-a1f4-7a68561ff148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:49.521908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5aacf-3512-4007-a1f4-7a68561ff148 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:49.522191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5aacf-3512-4007-a1f4-7a68561ff148 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:49.522467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5aacf-3512-4007-a1f4-7a68561ff148 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:49.523257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5aacf-3512-4007-a1f4-7a68561ff148 None admin] RBAC: Adding query filter params (interface=public, service_id=f9888a15b990402c9633f71b93b6075f, region_id=RegionOne) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:49.523563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5aacf-3512-4007-a1f4-7a68561ff148 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:49.524976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5aacf-3512-4007-a1f4-7a68561ff148 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:49.530799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 457/924] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Jun 2 13:02:49 2022] GET /identity/v3/endpoints?service_id=f9888a15b990402c9633f71b93b6075f&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:49.536438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73821757-3ad0-4c59-a878-21052a32f1c0 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:49.642375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73821757-3ad0-4c59-a878-21052a32f1c0 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:49.651921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:49.677788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8db1e-4ced-4c77-a2eb-9f2d520c1e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:49.678470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8db1e-4ced-4c77-a2eb-9f2d520c1e00 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:49.678755 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8db1e-4ced-4c77-a2eb-9f2d520c1e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:49.679029 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8db1e-4ced-4c77-a2eb-9f2d520c1e00 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:49.679716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8db1e-4ced-4c77-a2eb-9f2d520c1e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:49.681132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8db1e-4ced-4c77-a2eb-9f2d520c1e00 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:49.688377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 468/925] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Jun 2 13:02:49 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:02:49.780294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158598-4d54-42d6-9c16-c8812eaebcd3 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:49.780621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158598-4d54-42d6-9c16-c8812eaebcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:49.780861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91158598-4d54-42d6-9c16-c8812eaebcd3 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:49.782533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 458/926] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:49.789754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9a293-24e1-4bcf-a4bf-b99097905ca9 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:49.790054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9a293-24e1-4bcf-a4bf-b99097905ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:49.790326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9a293-24e1-4bcf-a4bf-b99097905ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:49.810444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-9fe9a293-24e1-4bcf-a4bf-b99097905ca9 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:49.811682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9fe9a293-24e1-4bcf-a4bf-b99097905ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:49.889057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 469/927] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:49.912236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91158598-4d54-42d6-9c16-c8812eaebcd3 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:50.020076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91158598-4d54-42d6-9c16-c8812eaebcd3 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:50.033657 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:50.059720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ad031-812b-450c-9275-427d1636bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:50.060628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ad031-812b-450c-9275-427d1636bfcd None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:50.060914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ad031-812b-450c-9275-427d1636bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:50.061193 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ad031-812b-450c-9275-427d1636bfcd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:50.061875 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ad031-812b-450c-9275-427d1636bfcd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:50.063372 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ad031-812b-450c-9275-427d1636bfcd None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-599ad031-812b-450c-9275-427d1636bfcd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:50.078640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:50.079670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:50.080570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 459/928] 10.222.0.46 () {56 vars in 1132 bytes} [Thu Jun 2 13:02:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:50.086339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9a293-24e1-4bcf-a4bf-b99097905ca9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:50.196584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9a293-24e1-4bcf-a4bf-b99097905ca9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:50.198734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:50.234385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e42f2-f18e-4881-b8f1-38efe1add85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:50.235240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e42f2-f18e-4881-b8f1-38efe1add85f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:50.235636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e42f2-f18e-4881-b8f1-38efe1add85f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:50.235954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e42f2-f18e-4881-b8f1-38efe1add85f None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:50.236679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e42f2-f18e-4881-b8f1-38efe1add85f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:50.236988 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e42f2-f18e-4881-b8f1-38efe1add85f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:50.238389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e42f2-f18e-4881-b8f1-38efe1add85f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:50.244377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 470/929] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:50.249752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ad031-812b-450c-9275-427d1636bfcd None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:50.357014 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ad031-812b-450c-9275-427d1636bfcd None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:50.393627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e07da2-dff2-4ae3-9a48-76b9a743abd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:50.394358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07da2-dff2-4ae3-9a48-76b9a743abd1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:50.394644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07da2-dff2-4ae3-9a48-76b9a743abd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:50.394923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07da2-dff2-4ae3-9a48-76b9a743abd1 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:50.395638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e07da2-dff2-4ae3-9a48-76b9a743abd1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:50.396273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e07da2-dff2-4ae3-9a48-76b9a743abd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:50.397375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e07da2-dff2-4ae3-9a48-76b9a743abd1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:50.404070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 460/930] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:50.409371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e07da2-dff2-4ae3-9a48-76b9a743abd1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:50.409623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91e169-cb91-469f-bc5e-ec1a6ed31355 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:50.410063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91e169-cb91-469f-bc5e-ec1a6ed31355 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:50.410152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91e169-cb91-469f-bc5e-ec1a6ed31355 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:50.411634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 471/931] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:50.421353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117badc9-3d5b-4bad-8723-04c41c124ba1 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:50.421663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117badc9-3d5b-4bad-8723-04c41c124ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:50.421913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117badc9-3d5b-4bad-8723-04c41c124ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:50.439493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-117badc9-3d5b-4bad-8723-04c41c124ba1 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:50.440825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-117badc9-3d5b-4bad-8723-04c41c124ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:50.457396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:50.516380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 472/932] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:50.516988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e07da2-dff2-4ae3-9a48-76b9a743abd1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:50.539743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117badc9-3d5b-4bad-8723-04c41c124ba1 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:50.552674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce333b-8835-4e63-8d0a-2aa7384f20ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:50.553350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce333b-8835-4e63-8d0a-2aa7384f20ae None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:50.553636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce333b-8835-4e63-8d0a-2aa7384f20ae None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:50.553914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce333b-8835-4e63-8d0a-2aa7384f20ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:50.554659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce333b-8835-4e63-8d0a-2aa7384f20ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:50.556199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce333b-8835-4e63-8d0a-2aa7384f20ae None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:50.643961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 461/933] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Jun 2 13:02:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:02:50.656493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:50.664117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117badc9-3d5b-4bad-8723-04c41c124ba1 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:50.710726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6452fa-4522-424f-b287-4961716b13e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:50.712173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6452fa-4522-424f-b287-4961716b13e1 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:50.712704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6452fa-4522-424f-b287-4961716b13e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:50.713240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6452fa-4522-424f-b287-4961716b13e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:50.726108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6452fa-4522-424f-b287-4961716b13e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-6e6452fa-4522-424f-b287-4961716b13e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:50.737049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:50.738108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:02:50.739219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:50.742243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 473/934] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Jun 2 13:02:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:50.748803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce333b-8835-4e63-8d0a-2aa7384f20ae None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:50.862163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:50.869965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce333b-8835-4e63-8d0a-2aa7384f20ae None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:50.906444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c02a4-d630-4af1-aaf6-b14daf23c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:50.907126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c02a4-d630-4af1-aaf6-b14daf23c9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:50.907412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c02a4-d630-4af1-aaf6-b14daf23c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:50.907691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c02a4-d630-4af1-aaf6-b14daf23c9d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:50.908478 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c02a4-d630-4af1-aaf6-b14daf23c9d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:50.908785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c02a4-d630-4af1-aaf6-b14daf23c9d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:50.910546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c02a4-d630-4af1-aaf6-b14daf23c9d8 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:50.920926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 462/935] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Jun 2 13:02:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:50.927668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6452fa-4522-424f-b287-4961716b13e1 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:51.038838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6452fa-4522-424f-b287-4961716b13e1 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:51.075308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b93b1-f44b-4aa9-93e1-fa56fa6caa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:51.076573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b93b1-f44b-4aa9-93e1-fa56fa6caa8a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:51.077065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b93b1-f44b-4aa9-93e1-fa56fa6caa8a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:51.077597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b93b1-f44b-4aa9-93e1-fa56fa6caa8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:51.089938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b93b1-f44b-4aa9-93e1-fa56fa6caa8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:51.091733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b93b1-f44b-4aa9-93e1-fa56fa6caa8a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-775b93b1-f44b-4aa9-93e1-fa56fa6caa8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:51.111095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:51.112172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:51.113055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:51.113055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:51.113055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:51.113055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:51.115619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 474/936] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:51.121783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c02a4-d630-4af1-aaf6-b14daf23c9d8 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:51.234010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c02a4-d630-4af1-aaf6-b14daf23c9d8 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:51.271732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd633b4-a1fb-415f-930e-cf0079c7715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:51.272830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd633b4-a1fb-415f-930e-cf0079c7715b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:51.273325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd633b4-a1fb-415f-930e-cf0079c7715b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:51.273820 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd633b4-a1fb-415f-930e-cf0079c7715b None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:51.274753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd633b4-a1fb-415f-930e-cf0079c7715b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:51.275267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd633b4-a1fb-415f-930e-cf0079c7715b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:51.276955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd633b4-a1fb-415f-930e-cf0079c7715b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:51.290395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 463/937] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:51.296410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b93b1-f44b-4aa9-93e1-fa56fa6caa8a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:51.301398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:51.413684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b93b1-f44b-4aa9-93e1-fa56fa6caa8a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:51.451518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ab15a-2fa3-46e3-bde5-18c036c7ffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:51.452411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ab15a-2fa3-46e3-bde5-18c036c7ffd3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:51.452703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ab15a-2fa3-46e3-bde5-18c036c7ffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:51.452985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ab15a-2fa3-46e3-bde5-18c036c7ffd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:51.462380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ab15a-2fa3-46e3-bde5-18c036c7ffd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:51.464505 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ab15a-2fa3-46e3-bde5-18c036c7ffd3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-9f6ab15a-2fa3-46e3-bde5-18c036c7ffd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:51.482259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:51.483280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:51.484276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 475/938] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Jun 2 13:02:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:51.493208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd633b4-a1fb-415f-930e-cf0079c7715b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:51.515109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:51.606166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd633b4-a1fb-415f-930e-cf0079c7715b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:51.643960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca974daf-316f-4c1a-ab5e-769f2c614e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:51.644703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca974daf-316f-4c1a-ab5e-769f2c614e92 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:51.644995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca974daf-316f-4c1a-ab5e-769f2c614e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:51.645277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca974daf-316f-4c1a-ab5e-769f2c614e92 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:51.646147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca974daf-316f-4c1a-ab5e-769f2c614e92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:51.646461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca974daf-316f-4c1a-ab5e-769f2c614e92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:51.647935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca974daf-316f-4c1a-ab5e-769f2c614e92 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:51.669250 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 464/939] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Jun 2 13:02:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:51.675173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ab15a-2fa3-46e3-bde5-18c036c7ffd3 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:51.747578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:51.788791 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ab15a-2fa3-46e3-bde5-18c036c7ffd3 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:51.804559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4c898-d6f9-4018-a189-4e23e93a6cee None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:51.805268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4c898-d6f9-4018-a189-4e23e93a6cee None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:51.805561 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4c898-d6f9-4018-a189-4e23e93a6cee None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:51.807650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 465/940] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:02:51.816391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8ca94-368f-4a56-bd1a-51763ea326a0 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:51.816657 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8ca94-368f-4a56-bd1a-51763ea326a0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:51.816939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8ca94-368f-4a56-bd1a-51763ea326a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:51.835210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4b165-e3b8-498e-ae31-4f3c7dc95367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:51.835451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-12b8ca94-368f-4a56-bd1a-51763ea326a0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:51.836538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-12b8ca94-368f-4a56-bd1a-51763ea326a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:51.836648 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b165-e3b8-498e-ae31-4f3c7dc95367 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:51.837148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b165-e3b8-498e-ae31-4f3c7dc95367 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:51.837616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b165-e3b8-498e-ae31-4f3c7dc95367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:51.852754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4b165-e3b8-498e-ae31-4f3c7dc95367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:51.855108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4b165-e3b8-498e-ae31-4f3c7dc95367 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-03a4b165-e3b8-498e-ae31-4f3c7dc95367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:51.878672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:51.879575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:51.880479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:51.880479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:51.880479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:51.880479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:51.881549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 476/941] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:51.888917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4b165-e3b8-498e-ae31-4f3c7dc95367 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:51.926594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 466/942] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:51.950682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8ca94-368f-4a56-bd1a-51763ea326a0 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:51.962850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:52.005460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4b165-e3b8-498e-ae31-4f3c7dc95367 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:52.032654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:52.052716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23133f19-5351-41c9-a53a-d9a82b39ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:52.053502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23133f19-5351-41c9-a53a-d9a82b39ee6e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.053787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23133f19-5351-41c9-a53a-d9a82b39ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.054070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23133f19-5351-41c9-a53a-d9a82b39ee6e None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.054807 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23133f19-5351-41c9-a53a-d9a82b39ee6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:52.055116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23133f19-5351-41c9-a53a-d9a82b39ee6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:52.056539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23133f19-5351-41c9-a53a-d9a82b39ee6e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:52.070127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 477/943] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:52.070496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8ca94-368f-4a56-bd1a-51763ea326a0 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:52.071476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22dfd6-9abb-4013-ae5d-c6d839c7264d None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.071764 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22dfd6-9abb-4013-ae5d-c6d839c7264d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.072068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22dfd6-9abb-4013-ae5d-c6d839c7264d None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.074049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 478/944] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:52.078124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22dfd6-9abb-4013-ae5d-c6d839c7264d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:52.113023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01229f49-9220-4f70-876c-a00b7af922b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:52.114343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229f49-9220-4f70-876c-a00b7af922b5 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.114792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229f49-9220-4f70-876c-a00b7af922b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.115220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229f49-9220-4f70-876c-a00b7af922b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.115938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01229f49-9220-4f70-876c-a00b7af922b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:52.117433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01229f49-9220-4f70-876c-a00b7af922b5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:52.118847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: WARNING keystone.server.flask.common [None req-01229f49-9220-4f70-876c-a00b7af922b5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 13:02:52.168505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.sql.core [None req-01229f49-9220-4f70-876c-a00b7af922b5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:02:52.168505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 13:02:52.168505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [parameters: {'id': '22c89d7ebc3d4bcc885921269145b068', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 13:02:52.168505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80583) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:02:52.186164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22dfd6-9abb-4013-ae5d-c6d839c7264d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-01229f49-9220-4f70-876c-a00b7af922b5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 22c89d7ebc3d4bcc885921269145b068.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 22c89d7ebc3d4bcc885921269145b068. Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:02:52.186382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application result.read() Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 13:02:52.187156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application yield resource Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise self.value Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application session.commit() Jun 02 13:02:52.188419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:02:52.189313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:02:52.190190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application result.read() Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:02:52.191070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [parameters: {'id': '22c89d7ebc3d4bcc885921269145b068', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:52.192614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:52.194139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 22c89d7ebc3d4bcc885921269145b068. Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 467/945] 10.222.0.46 () {60 vars in 1140 bytes} [Thu Jun 2 13:02:51 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f25d9-cf50-431c-a1fb-774b6b03c544 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.195570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f25d9-cf50-431c-a1fb-774b6b03c544 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.196414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f25d9-cf50-431c-a1fb-774b6b03c544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.210621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-256f25d9-cf50-431c-a1fb-774b6b03c544 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:52.212247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-256f25d9-cf50-431c-a1fb-774b6b03c544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:52.233772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51884693-d94a-441c-bda7-1b432d9c3c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:52.234665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51884693-d94a-441c-bda7-1b432d9c3c2a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.234955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51884693-d94a-441c-bda7-1b432d9c3c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.235232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51884693-d94a-441c-bda7-1b432d9c3c2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.242590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51884693-d94a-441c-bda7-1b432d9c3c2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:52.244081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51884693-d94a-441c-bda7-1b432d9c3c2a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-51884693-d94a-441c-bda7-1b432d9c3c2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:52.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:52.259493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:52.261325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:52.261325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:52.261325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:52.261325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:52.261325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:52.261325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:52.261325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:52.261325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:52.261325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 479/946] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:52.261844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51884693-d94a-441c-bda7-1b432d9c3c2a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:52.276434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:52.294471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 468/947] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:52.294471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f25d9-cf50-431c-a1fb-774b6b03c544 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:52.313018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:52.399242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51884693-d94a-441c-bda7-1b432d9c3c2a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:52.400932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f25d9-cf50-431c-a1fb-774b6b03c544 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:52.438758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2ca3e-ea60-4629-b8ed-58bab6bf4977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:52.439280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d3093-9770-44cb-9f39-6f3fb5bc6d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:52.439531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ca3e-ea60-4629-b8ed-58bab6bf4977 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.439649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d3093-9770-44cb-9f39-6f3fb5bc6d8a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.439800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ca3e-ea60-4629-b8ed-58bab6bf4977 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.440006 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d3093-9770-44cb-9f39-6f3fb5bc6d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.440092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2ca3e-ea60-4629-b8ed-58bab6bf4977 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.440233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d3093-9770-44cb-9f39-6f3fb5bc6d8a None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.440988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d3093-9770-44cb-9f39-6f3fb5bc6d8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:52.441306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d3093-9770-44cb-9f39-6f3fb5bc6d8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:52.443624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d3093-9770-44cb-9f39-6f3fb5bc6d8a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:52.448151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2ca3e-ea60-4629-b8ed-58bab6bf4977 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:52.449627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2ca3e-ea60-4629-b8ed-58bab6bf4977 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:52.460551 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 469/948] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:52.462378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d3093-9770-44cb-9f39-6f3fb5bc6d8a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-13c2ca3e-ea60-4629-b8ed-58bab6bf4977 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:52.465537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:52.466419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:52.467332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:52.467332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:52.467332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:52.467332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:52.467332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:52.467332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:52.467332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:52.467332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:52.467332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 480/949] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:52.467811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2ca3e-ea60-4629-b8ed-58bab6bf4977 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:52.531079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:52.571679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:52.577938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2ca3e-ea60-4629-b8ed-58bab6bf4977 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:52.586465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d3093-9770-44cb-9f39-6f3fb5bc6d8a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:52.617391 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd18a20-3f7b-488f-aa4b-7f72b182383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:52.618314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18a20-3f7b-488f-aa4b-7f72b182383c None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.618596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18a20-3f7b-488f-aa4b-7f72b182383c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.618862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18a20-3f7b-488f-aa4b-7f72b182383c None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/4683d277112848ce9b49db3b15aaa32c/roles/545468338c4445a78e84a2ad0660817c` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.621845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd18a20-3f7b-488f-aa4b-7f72b182383c None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=4683d277112848ce9b49db3b15aaa32c, role_id=545468338c4445a78e84a2ad0660817c)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:52.623322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd18a20-3f7b-488f-aa4b-7f72b182383c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:52.624765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9a6fe-6f1d-4285-8f8a-30de41c8be73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:52.625584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9a6fe-6f1d-4285-8f8a-30de41c8be73 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.625865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9a6fe-6f1d-4285-8f8a-30de41c8be73 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.626141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9a6fe-6f1d-4285-8f8a-30de41c8be73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.626795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9a6fe-6f1d-4285-8f8a-30de41c8be73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:52.628196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9a6fe-6f1d-4285-8f8a-30de41c8be73 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-d4d9a6fe-6f1d-4285-8f8a-30de41c8be73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:52.640721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:52.644090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:52.645025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 470/950] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:52.645911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9a6fe-6f1d-4285-8f8a-30de41c8be73 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:52.698286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 481/951] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:02:52 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/4683d277112848ce9b49db3b15aaa32c/roles/545468338c4445a78e84a2ad0660817c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:02:52.698286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd18a20-3f7b-488f-aa4b-7f72b182383c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:52.769557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9a6fe-6f1d-4285-8f8a-30de41c8be73 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:52.790937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:52.813500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed532e-88e3-40f2-8371-1808a6d890a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:52.814176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed532e-88e3-40f2-8371-1808a6d890a3 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.814457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed532e-88e3-40f2-8371-1808a6d890a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.814742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed532e-88e3-40f2-8371-1808a6d890a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.815571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed532e-88e3-40f2-8371-1808a6d890a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:52.815901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed532e-88e3-40f2-8371-1808a6d890a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:52.817390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed532e-88e3-40f2-8371-1808a6d890a3 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:52.837644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 471/952] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:52.849548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd18a20-3f7b-488f-aa4b-7f72b182383c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:52.892429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054947cd-6fd4-462f-a123-b5eb3faeb5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:52.893392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054947cd-6fd4-462f-a123-b5eb3faeb5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:52.893857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054947cd-6fd4-462f-a123-b5eb3faeb5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:52.894300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054947cd-6fd4-462f-a123-b5eb3faeb5f9 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:52.895183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054947cd-6fd4-462f-a123-b5eb3faeb5f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:52.895646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054947cd-6fd4-462f-a123-b5eb3faeb5f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:52.897285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054947cd-6fd4-462f-a123-b5eb3faeb5f9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:52.904301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 482/953] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Jun 2 13:02:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:52.910702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed532e-88e3-40f2-8371-1808a6d890a3 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:53.038662 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed532e-88e3-40f2-8371-1808a6d890a3 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:53.078660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82499e-2f04-4560-b3b3-efd2239061f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:53.079346 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82499e-2f04-4560-b3b3-efd2239061f7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:53.079635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82499e-2f04-4560-b3b3-efd2239061f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:53.079943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82499e-2f04-4560-b3b3-efd2239061f7 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:53.080664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82499e-2f04-4560-b3b3-efd2239061f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:53.080973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82499e-2f04-4560-b3b3-efd2239061f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:53.082348 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82499e-2f04-4560-b3b3-efd2239061f7 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:53.088485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 472/954] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Jun 2 13:02:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:53.094358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054947cd-6fd4-462f-a123-b5eb3faeb5f9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:53.106504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99401b2d-5c9a-476a-89e9-c283a4d15995 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:53.106817 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99401b2d-5c9a-476a-89e9-c283a4d15995 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:53.107131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99401b2d-5c9a-476a-89e9-c283a4d15995 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:53.108825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 473/955] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:02:53.114105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4a535-8285-4d03-a76a-e5d83f7f2e8e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:53.114443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4a535-8285-4d03-a76a-e5d83f7f2e8e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:53.114680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4a535-8285-4d03-a76a-e5d83f7f2e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:53.117962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:53.132867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-98d4a535-8285-4d03-a76a-e5d83f7f2e8e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:53.134081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-98d4a535-8285-4d03-a76a-e5d83f7f2e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:53.175123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:53.218442 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054947cd-6fd4-462f-a123-b5eb3faeb5f9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:53.218917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 474/956] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:53.238356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4a535-8285-4d03-a76a-e5d83f7f2e8e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:53.254716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1621-4eef-4d85-ba87-5a6819118d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:53.255390 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1621-4eef-4d85-ba87-5a6819118d80 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:53.255672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1621-4eef-4d85-ba87-5a6819118d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:53.256001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1621-4eef-4d85-ba87-5a6819118d80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:53.256834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1621-4eef-4d85-ba87-5a6819118d80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:53.258266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a1621-4eef-4d85-ba87-5a6819118d80 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:53.341736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 483/957] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Jun 2 13:02:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:02:53.356726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4a535-8285-4d03-a76a-e5d83f7f2e8e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:53.405921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb842b-ab1f-4692-90bc-de436afef69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:53.406731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb842b-ab1f-4692-90bc-de436afef69c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:53.407018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb842b-ab1f-4692-90bc-de436afef69c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:53.407363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb842b-ab1f-4692-90bc-de436afef69c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:53.408051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb842b-ab1f-4692-90bc-de436afef69c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:53.409440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb842b-ab1f-4692-90bc-de436afef69c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-c2cb842b-ab1f-4692-90bc-de436afef69c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:53.422766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:53.423824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:02:53.424693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:53.429361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 475/958] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:53.430820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1621-4eef-4d85-ba87-5a6819118d80 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:53.524608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:53.550526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a1621-4eef-4d85-ba87-5a6819118d80 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:53.584826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc3bf1-bda9-4c5f-8053-5a3712eb936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:53.585489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3bf1-bda9-4c5f-8053-5a3712eb936e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:53.585769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3bf1-bda9-4c5f-8053-5a3712eb936e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:53.586041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc3bf1-bda9-4c5f-8053-5a3712eb936e None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:53.586744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc3bf1-bda9-4c5f-8053-5a3712eb936e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:53.587048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc3bf1-bda9-4c5f-8053-5a3712eb936e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:53.588977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc3bf1-bda9-4c5f-8053-5a3712eb936e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:53.593878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 484/959] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:53.605987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb842b-ab1f-4692-90bc-de436afef69c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:53.642381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:53.731608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb842b-ab1f-4692-90bc-de436afef69c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:53.767012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fcaf7-6723-4fe2-ab82-00b350323105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:53.767681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fcaf7-6723-4fe2-ab82-00b350323105 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:53.767993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fcaf7-6723-4fe2-ab82-00b350323105 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:53.768269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fcaf7-6723-4fe2-ab82-00b350323105 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:53.768972 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fcaf7-6723-4fe2-ab82-00b350323105 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:53.769275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fcaf7-6723-4fe2-ab82-00b350323105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:53.770630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fcaf7-6723-4fe2-ab82-00b350323105 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:53.776180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 476/960] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:55.058329 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74e05-ae58-479d-b193-d2cdffb2a3a6 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.058853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74e05-ae58-479d-b193-d2cdffb2a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.058930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74e05-ae58-479d-b193-d2cdffb2a3a6 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.060522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 485/961] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:55.066108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97f9ff-3cb9-4e30-b658-a69767bae5ca None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.066533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97f9ff-3cb9-4e30-b658-a69767bae5ca None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.066724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97f9ff-3cb9-4e30-b658-a69767bae5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.086056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-7f97f9ff-3cb9-4e30-b658-a69767bae5ca None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:55.087269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7f97f9ff-3cb9-4e30-b658-a69767bae5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:55.169358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 477/962] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:55.192815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e74e05-ae58-479d-b193-d2cdffb2a3a6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:55.255147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3339d96-5746-4658-b132-7e9fa0176a04 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.255437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3339d96-5746-4658-b132-7e9fa0176a04 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.255914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3339d96-5746-4658-b132-7e9fa0176a04 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.257570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 478/963] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:55.262879 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915c8e-1e67-4e0f-ada4-21d919655574 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.263175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915c8e-1e67-4e0f-ada4-21d919655574 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.263463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915c8e-1e67-4e0f-ada4-21d919655574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.285764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-e5915c8e-1e67-4e0f-ada4-21d919655574 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:55.287305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e5915c8e-1e67-4e0f-ada4-21d919655574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:55.312240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e74e05-ae58-479d-b193-d2cdffb2a3a6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:55.315113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:55.358739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d6935-fdbe-4160-ad32-5bbbe225bdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:55.359949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d6935-fdbe-4160-ad32-5bbbe225bdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.360258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d6935-fdbe-4160-ad32-5bbbe225bdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.360535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d6935-fdbe-4160-ad32-5bbbe225bdf2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.379580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:55.379776 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 479/964] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:55.382914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d6935-fdbe-4160-ad32-5bbbe225bdf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-e79d6935-fdbe-4160-ad32-5bbbe225bdf2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:02:55.391782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:55.395641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:55.396514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 486/965] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Jun 2 13:02:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:55.401518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5915c8e-1e67-4e0f-ada4-21d919655574 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:55.408695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d6935-fdbe-4160-ad32-5bbbe225bdf2 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:55.519954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5915c8e-1e67-4e0f-ada4-21d919655574 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:55.537016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d6935-fdbe-4160-ad32-5bbbe225bdf2 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:55.557311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e8977-498c-4030-8fa1-77852269b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:55.558370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e8977-498c-4030-8fa1-77852269b772 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.558859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e8977-498c-4030-8fa1-77852269b772 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.559359 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e8977-498c-4030-8fa1-77852269b772 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.560342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e8977-498c-4030-8fa1-77852269b772 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:55.560867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e8977-498c-4030-8fa1-77852269b772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:55.562520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e8977-498c-4030-8fa1-77852269b772 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:55.578422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 480/966] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Jun 2 13:02:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:55.579496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e8977-498c-4030-8fa1-77852269b772 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:55.580700 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:55.581408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.581683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.581953 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.582743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:55.584363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:55.585665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WARNING keystone.server.flask.common [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 13:02:55.606775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:55.614021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.sql.core [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:02:55.614021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 13:02:55.614021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [parameters: {'user_id': 'd096c9da041e4261b99aa1b4c7758b12', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 13:02:55.614021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80584) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application result.read() Jun 02 13:02:55.622085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:02:55.625589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application yield resource Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise self.value Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application session.commit() Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:02:55.626723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:02:55.627693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:02:55.629286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application result.read() Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:02:55.631381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd096c9da041e4261b99aa1b4c7758b12', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:55.633333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 13:02:55.634332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 13:02:55.644303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 13:02:55.644303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 13:02:55.644303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:02:55.644303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:02:55.644303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 13:02:55.644303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:55.644303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 487/967] 10.222.0.46 () {60 vars in 1131 bytes} [Thu Jun 2 13:02:55 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:55.644303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:55.701403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:55.718359 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e8977-498c-4030-8fa1-77852269b772 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:55.749399 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9078c6-974b-4995-a19d-8c6324c964ad None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:55.756410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5c9b6-87d7-4d98-9dcb-e6360573d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:55.757645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5c9b6-87d7-4d98-9dcb-e6360573d360 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.757938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5c9b6-87d7-4d98-9dcb-e6360573d360 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.758222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5c9b6-87d7-4d98-9dcb-e6360573d360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.771584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5c9b6-87d7-4d98-9dcb-e6360573d360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:55.775951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5c9b6-87d7-4d98-9dcb-e6360573d360 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:55.796112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb344d02-8b57-4530-9cfa-4742447dfdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:55.797278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb344d02-8b57-4530-9cfa-4742447dfdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.797770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb344d02-8b57-4530-9cfa-4742447dfdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.798334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb344d02-8b57-4530-9cfa-4742447dfdc9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-a8e5c9b6-87d7-4d98-9dcb-e6360573d360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:55.799895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:55.800763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:55.802218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:55.802218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:55.802218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:55.802218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:55.802218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 481/968] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:55.806637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5c9b6-87d7-4d98-9dcb-e6360573d360 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:55.811067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb344d02-8b57-4530-9cfa-4742447dfdc9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:55.812913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb344d02-8b57-4530-9cfa-4742447dfdc9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-fb344d02-8b57-4530-9cfa-4742447dfdc9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:55.829169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:55.830156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:55.831069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:55.831069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:55.831069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:55.831069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:55.831069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:55.831069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:55.831069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:55.831069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:55.831069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:02:55.831069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:55.835264 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 488/969] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:02:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:55.836731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb344d02-8b57-4530-9cfa-4742447dfdc9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:55.885229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:55.922226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5c9b6-87d7-4d98-9dcb-e6360573d360 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:55.944558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb344d02-8b57-4530-9cfa-4742447dfdc9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:55.959110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadea576-bc11-45e5-b829-682672bc3a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:55.960180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadea576-bc11-45e5-b829-682672bc3a85 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.960677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadea576-bc11-45e5-b829-682672bc3a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.961157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadea576-bc11-45e5-b829-682672bc3a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.962100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadea576-bc11-45e5-b829-682672bc3a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:55.962607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadea576-bc11-45e5-b829-682672bc3a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:55.964754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadea576-bc11-45e5-b829-682672bc3a85 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:55.968253 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:55.983834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 482/970] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:55.983834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e4d73-42c4-4ff2-9c41-a75da9dc2f66 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.983834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e4d73-42c4-4ff2-9c41-a75da9dc2f66 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.983834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e4d73-42c4-4ff2-9c41-a75da9dc2f66 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.983834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 483/971] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:55.985573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e4d73-42c4-4ff2-9c41-a75da9dc2f66 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:55.990888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc010e0-b996-4301-9aad-aba8129406e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:55.991831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc010e0-b996-4301-9aad-aba8129406e4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:55.992346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc010e0-b996-4301-9aad-aba8129406e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:55.992800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc010e0-b996-4301-9aad-aba8129406e4 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:55.993798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc010e0-b996-4301-9aad-aba8129406e4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:55.994733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc010e0-b996-4301-9aad-aba8129406e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:55.996774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc010e0-b996-4301-9aad-aba8129406e4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:56.038122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 489/972] 10.222.0.46 () {56 vars in 1101 bytes} [Thu Jun 2 13:02:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:56.039811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751f9c0-9caf-480d-9aa8-b6651228ca6b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.040256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751f9c0-9caf-480d-9aa8-b6651228ca6b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.040542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751f9c0-9caf-480d-9aa8-b6651228ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.059609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0751f9c0-9caf-480d-9aa8-b6651228ca6b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:56.061353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0751f9c0-9caf-480d-9aa8-b6651228ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:56.108595 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e4d73-42c4-4ff2-9c41-a75da9dc2f66 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:56.140258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:56.146591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 490/973] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:56.148350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e78cf2-8ae4-4dab-ad5a-d5763e16c14b None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.148787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e78cf2-8ae4-4dab-ad5a-d5763e16c14b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.148992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e78cf2-8ae4-4dab-ad5a-d5763e16c14b None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.155936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 491/974] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:56.157244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e32e4-b3e0-49c8-bdca-c17a40960ee7 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.157691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e32e4-b3e0-49c8-bdca-c17a40960ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.158057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e32e4-b3e0-49c8-bdca-c17a40960ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.163616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03182c30-0eff-4f69-96a4-a73e8047312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:56.169542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03182c30-0eff-4f69-96a4-a73e8047312e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.169542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03182c30-0eff-4f69-96a4-a73e8047312e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.169542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03182c30-0eff-4f69-96a4-a73e8047312e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.175335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03182c30-0eff-4f69-96a4-a73e8047312e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:56.176868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03182c30-0eff-4f69-96a4-a73e8047312e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:56.177469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8a7e32e4-b3e0-49c8-bdca-c17a40960ee7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:56.178747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8a7e32e4-b3e0-49c8-bdca-c17a40960ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-03182c30-0eff-4f69-96a4-a73e8047312e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:02:56.193869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:56.194950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:56.195934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 484/975] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Jun 2 13:02:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:56.197190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03182c30-0eff-4f69-96a4-a73e8047312e None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:56.270311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 492/976] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:02:56.270982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e32e4-b3e0-49c8-bdca-c17a40960ee7 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:56.315969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03182c30-0eff-4f69-96a4-a73e8047312e None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:56.316290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:56.355836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7658c2-66c6-4d04-bba9-1c7725504a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:56.356683 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7658c2-66c6-4d04-bba9-1c7725504a52 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.356967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7658c2-66c6-4d04-bba9-1c7725504a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.357242 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7658c2-66c6-4d04-bba9-1c7725504a52 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.357896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7658c2-66c6-4d04-bba9-1c7725504a52 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:56.359311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7658c2-66c6-4d04-bba9-1c7725504a52 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-fb7658c2-66c6-4d04-bba9-1c7725504a52 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:56.372003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:56.373069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:56.373913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 485/977] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:56.374704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7658c2-66c6-4d04-bba9-1c7725504a52 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:56.389079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e32e4-b3e0-49c8-bdca-c17a40960ee7 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:56.425895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:56.426062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88de72b-52cb-4a36-91d0-6718599778df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:56.426717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de72b-52cb-4a36-91d0-6718599778df None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.427001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de72b-52cb-4a36-91d0-6718599778df None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.427269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de72b-52cb-4a36-91d0-6718599778df None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.428137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88de72b-52cb-4a36-91d0-6718599778df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:56.428446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88de72b-52cb-4a36-91d0-6718599778df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:56.429869 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88de72b-52cb-4a36-91d0-6718599778df None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:56.446828 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 493/978] 10.222.0.46 () {56 vars in 1149 bytes} [Thu Jun 2 13:02:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:56.448201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88de72b-52cb-4a36-91d0-6718599778df None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:56.474270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7658c2-66c6-4d04-bba9-1c7725504a52 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:56.507726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ead6f-be93-4c55-a4d9-086200067325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:56.508410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ead6f-be93-4c55-a4d9-086200067325 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.508691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ead6f-be93-4c55-a4d9-086200067325 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.509029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ead6f-be93-4c55-a4d9-086200067325 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.510239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ead6f-be93-4c55-a4d9-086200067325 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:56.511594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ead6f-be93-4c55-a4d9-086200067325 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:56.545276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:56.548907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88de72b-52cb-4a36-91d0-6718599778df None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:56.579828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 486/979] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:02:56 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:02:56.580666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ead6f-be93-4c55-a4d9-086200067325 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:56.589105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2f46-398d-4ba1-88bc-fb882e468162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:56.589908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2f46-398d-4ba1-88bc-fb882e468162 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.590192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2f46-398d-4ba1-88bc-fb882e468162 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.590468 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2f46-398d-4ba1-88bc-fb882e468162 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.591203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c2f46-398d-4ba1-88bc-fb882e468162 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:56.591519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c2f46-398d-4ba1-88bc-fb882e468162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:56.592975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c2f46-398d-4ba1-88bc-fb882e468162 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:56.604212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 494/980] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Jun 2 13:02:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:56.605494 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2f46-398d-4ba1-88bc-fb882e468162 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:56.706475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ead6f-be93-4c55-a4d9-086200067325 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:56.722749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:56.725643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2f46-398d-4ba1-88bc-fb882e468162 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:56.746767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5dbb7-c264-44db-84fd-1f4e868bdb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:56.747440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5dbb7-c264-44db-84fd-1f4e868bdb5b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.747729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5dbb7-c264-44db-84fd-1f4e868bdb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.748046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5dbb7-c264-44db-84fd-1f4e868bdb5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.764660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de7faa-e921-4818-9928-286a47671765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:56.765352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de7faa-e921-4818-9928-286a47671765 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.765646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de7faa-e921-4818-9928-286a47671765 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.765931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de7faa-e921-4818-9928-286a47671765 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.766655 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de7faa-e921-4818-9928-286a47671765 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:56.767026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de7faa-e921-4818-9928-286a47671765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:56.768394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de7faa-e921-4818-9928-286a47671765 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:56.774127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 495/981] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Jun 2 13:02:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:56.780760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de7faa-e921-4818-9928-286a47671765 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:56.809562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:56.827544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5dbb7-c264-44db-84fd-1f4e868bdb5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:56.829075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5dbb7-c264-44db-84fd-1f4e868bdb5b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:56.894943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de7faa-e921-4818-9928-286a47671765 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:56.936051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf30e9-0034-4f7d-bd92-ae13bff52f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:56.937030 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf30e9-0034-4f7d-bd92-ae13bff52f86 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:56.937454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf30e9-0034-4f7d-bd92-ae13bff52f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:56.937873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf30e9-0034-4f7d-bd92-ae13bff52f86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:56.938813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf30e9-0034-4f7d-bd92-ae13bff52f86 None admin] RBAC: Adding query filter params (interface=admin, service_id=f9888a15b990402c9633f71b93b6075f, region_id=RegionOne) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:56.939257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf30e9-0034-4f7d-bd92-ae13bff52f86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:56.939414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 487/982] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:02:56 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:02:56.941237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf30e9-0034-4f7d-bd92-ae13bff52f86 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:56.945164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5dbb7-c264-44db-84fd-1f4e868bdb5b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:56.949901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 496/983] 10.222.0.46 () {56 vars in 1249 bytes} [Thu Jun 2 13:02:56 2022] GET /identity/v3/endpoints?service_id=f9888a15b990402c9633f71b93b6075f&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:56.955049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf30e9-0034-4f7d-bd92-ae13bff52f86 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:56.961798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:57.045577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:57.050471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5dbb7-c264-44db-84fd-1f4e868bdb5b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:57.060332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf30e9-0034-4f7d-bd92-ae13bff52f86 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:57.092778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b934dc-a1ec-4aea-b8af-9df41f98ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:57.093756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b934dc-a1ec-4aea-b8af-9df41f98ca0e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:57.094045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b934dc-a1ec-4aea-b8af-9df41f98ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:57.094327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b934dc-a1ec-4aea-b8af-9df41f98ca0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:57.099120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c191615-a393-47d7-bc67-6580ed6dad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:57.099789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c191615-a393-47d7-bc67-6580ed6dad6f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:57.100099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c191615-a393-47d7-bc67-6580ed6dad6f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:57.100371 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c191615-a393-47d7-bc67-6580ed6dad6f None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:57.101051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c191615-a393-47d7-bc67-6580ed6dad6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:57.102425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c191615-a393-47d7-bc67-6580ed6dad6f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:57.108105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b934dc-a1ec-4aea-b8af-9df41f98ca0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:57.109607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 497/984] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Jun 2 13:02:56 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:02:57.109725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b934dc-a1ec-4aea-b8af-9df41f98ca0e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-f1b934dc-a1ec-4aea-b8af-9df41f98ca0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:02:57.130208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:57.131264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:57.137222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:02:57.137222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:02:57.137222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:02:57.137222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:57.137222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 488/985] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:02:57.139011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c191615-a393-47d7-bc67-6580ed6dad6f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:57.251858 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c191615-a393-47d7-bc67-6580ed6dad6f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:57.289193 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c85c3e-b712-42f9-b210-b1402df68d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:57.289883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c85c3e-b712-42f9-b210-b1402df68d40 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:57.290166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c85c3e-b712-42f9-b210-b1402df68d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:57.290444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c85c3e-b712-42f9-b210-b1402df68d40 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:57.291719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c85c3e-b712-42f9-b210-b1402df68d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:57.292068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c85c3e-b712-42f9-b210-b1402df68d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:57.293686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c85c3e-b712-42f9-b210-b1402df68d40 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:57.312034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 498/986] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:57.313301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b934dc-a1ec-4aea-b8af-9df41f98ca0e None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:57.388555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:57.431982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b934dc-a1ec-4aea-b8af-9df41f98ca0e None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:57.468214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7d11-9c23-42b1-a812-45bf7a7c58d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:57.469026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7d11-9c23-42b1-a812-45bf7a7c58d6 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:57.469316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7d11-9c23-42b1-a812-45bf7a7c58d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:57.469588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7d11-9c23-42b1-a812-45bf7a7c58d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:57.476882 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d7d11-9c23-42b1-a812-45bf7a7c58d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:57.478373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d7d11-9c23-42b1-a812-45bf7a7c58d6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-c22d7d11-9c23-42b1-a812-45bf7a7c58d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:02:57.493565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:57.494532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:57.495519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:02:57.495519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:02:57.495519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:02:57.495519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:02:57.495519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:02:57.495519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:02:57.495519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:02:57.495519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:57.495519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 489/987] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:57.502320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c85c3e-b712-42f9-b210-b1402df68d40 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:57.516197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:57.607777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c85c3e-b712-42f9-b210-b1402df68d40 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:57.642292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e07a5-184b-4d60-8574-3248ac61f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:57.642956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e07a5-184b-4d60-8574-3248ac61f0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:57.643237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e07a5-184b-4d60-8574-3248ac61f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:57.643510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e07a5-184b-4d60-8574-3248ac61f0f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:57.644330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e07a5-184b-4d60-8574-3248ac61f0f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:57.644648 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e07a5-184b-4d60-8574-3248ac61f0f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:57.646072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e07a5-184b-4d60-8574-3248ac61f0f3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:57.664373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 499/988] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:57.667141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7d11-9c23-42b1-a812-45bf7a7c58d6 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:57.779125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7d11-9c23-42b1-a812-45bf7a7c58d6 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:57.803273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:57.814398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a204b3-2832-4ae2-8f7b-2bd35d518848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:57.815074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a204b3-2832-4ae2-8f7b-2bd35d518848 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:57.815368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a204b3-2832-4ae2-8f7b-2bd35d518848 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:57.825634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a204b3-2832-4ae2-8f7b-2bd35d518848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:57.825634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a204b3-2832-4ae2-8f7b-2bd35d518848 None admin] RBAC: Adding query filter params (role.id=545468338c4445a78e84a2ad0660817c, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=4683d277112848ce9b49db3b15aaa32c) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:57.825634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a204b3-2832-4ae2-8f7b-2bd35d518848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:57.825634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a204b3-2832-4ae2-8f7b-2bd35d518848 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:57.828237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 490/989] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:02:57 2022] GET /identity/v3/role_assignments?user.id=4683d277112848ce9b49db3b15aaa32c&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=545468338c4445a78e84a2ad0660817c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:58.891092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46982d-7500-451e-be01-3cca9051cfae None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:58.891671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46982d-7500-451e-be01-3cca9051cfae None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:58.891671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46982d-7500-451e-be01-3cca9051cfae None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:58.895917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 500/990] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:58.899111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a67f45-f11a-495a-b3e5-349d223b98c0 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:58.899549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a67f45-f11a-495a-b3e5-349d223b98c0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:58.899722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a67f45-f11a-495a-b3e5-349d223b98c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:58.918080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f8a67f45-f11a-495a-b3e5-349d223b98c0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:58.919259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f8a67f45-f11a-495a-b3e5-349d223b98c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:59.004950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 491/991] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:59.028268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46982d-7500-451e-be01-3cca9051cfae None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:59.113849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:59.152578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46982d-7500-451e-be01-3cca9051cfae None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:59.188416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951537e8-453e-413b-afc9-1eff17e5b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:59.189226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951537e8-453e-413b-afc9-1eff17e5b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:59.189533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951537e8-453e-413b-afc9-1eff17e5b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:59.189805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951537e8-453e-413b-afc9-1eff17e5b0b9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:59.190416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951537e8-453e-413b-afc9-1eff17e5b0b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:59.191790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951537e8-453e-413b-afc9-1eff17e5b0b9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-951537e8-453e-413b-afc9-1eff17e5b0b9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:59.208849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:59.209934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:02:59.210789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 501/992] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:02:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:59.218261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a67f45-f11a-495a-b3e5-349d223b98c0 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:59.327040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a67f45-f11a-495a-b3e5-349d223b98c0 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:59.349091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:59.370669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d0b50-e535-4b05-bad6-cb1af3620f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:59.371348 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0b50-e535-4b05-bad6-cb1af3620f2b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:59.371724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0b50-e535-4b05-bad6-cb1af3620f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:59.372049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0b50-e535-4b05-bad6-cb1af3620f2b None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:59.372766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d0b50-e535-4b05-bad6-cb1af3620f2b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:59.373070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d0b50-e535-4b05-bad6-cb1af3620f2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:59.374455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d0b50-e535-4b05-bad6-cb1af3620f2b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:59.383513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421623ff-1bc1-45ae-a1e4-1d26ab9015dc None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:59.383824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421623ff-1bc1-45ae-a1e4-1d26ab9015dc None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:59.384568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421623ff-1bc1-45ae-a1e4-1d26ab9015dc None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:59.385540 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 502/993] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:02:59.391746 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 492/994] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:59.393431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421623ff-1bc1-45ae-a1e4-1d26ab9015dc None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:59.395842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b365cc8-1e90-4142-a1f0-1535565ead23 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:59.396163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b365cc8-1e90-4142-a1f0-1535565ead23 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:59.396448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b365cc8-1e90-4142-a1f0-1535565ead23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:59.417446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9b365cc8-1e90-4142-a1f0-1535565ead23 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:02:59.418570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9b365cc8-1e90-4142-a1f0-1535565ead23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:02:59.497018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 493/995] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:02:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:02:59.520342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b365cc8-1e90-4142-a1f0-1535565ead23 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:59.527523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421623ff-1bc1-45ae-a1e4-1d26ab9015dc None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:59.579214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c716c8-4393-480c-8c91-c0a9000b023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:59.579923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c716c8-4393-480c-8c91-c0a9000b023a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:59.580210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c716c8-4393-480c-8c91-c0a9000b023a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:59.580510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c716c8-4393-480c-8c91-c0a9000b023a None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:59.581197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c716c8-4393-480c-8c91-c0a9000b023a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:59.581631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c716c8-4393-480c-8c91-c0a9000b023a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:59.582910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c716c8-4393-480c-8c91-c0a9000b023a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:59.586827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:59.592478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 503/996] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:02:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:59.596200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c716c8-4393-480c-8c91-c0a9000b023a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:59.646717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b365cc8-1e90-4142-a1f0-1535565ead23 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:59.661720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:59.689646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd926b8-3586-409d-81af-a0badf2dff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:59.690749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd926b8-3586-409d-81af-a0badf2dff9b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:59.691455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd926b8-3586-409d-81af-a0badf2dff9b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:59.691732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd926b8-3586-409d-81af-a0badf2dff9b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:59.692421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd926b8-3586-409d-81af-a0badf2dff9b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:59.693821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd926b8-3586-409d-81af-a0badf2dff9b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-dcd926b8-3586-409d-81af-a0badf2dff9b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:02:59.707183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:02:59.712150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:02:59.713116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 494/997] 10.222.0.46 () {56 vars in 1126 bytes} [Thu Jun 2 13:02:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:02:59.714970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd926b8-3586-409d-81af-a0badf2dff9b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:59.728760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c716c8-4393-480c-8c91-c0a9000b023a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:59.775114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed494057-ff3c-4950-ade9-b4347643a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:59.775114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed494057-ff3c-4950-ade9-b4347643a3fd None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:59.775114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed494057-ff3c-4950-ade9-b4347643a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:59.775114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed494057-ff3c-4950-ade9-b4347643a3fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:59.776578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed494057-ff3c-4950-ade9-b4347643a3fd None admin] RBAC: Adding query filter params (interface=public, service_id=91fe127cd2b84d94beadcfb2ab13bb8c, region_id=RegionOne) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:59.776901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed494057-ff3c-4950-ade9-b4347643a3fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:59.779227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed494057-ff3c-4950-ade9-b4347643a3fd None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:59.785260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 504/998] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Jun 2 13:02:59 2022] GET /identity/v3/endpoints?service_id=91fe127cd2b84d94beadcfb2ab13bb8c&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:02:59.793280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed494057-ff3c-4950-ade9-b4347643a3fd None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:59.844476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd926b8-3586-409d-81af-a0badf2dff9b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:59.877179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:59.882239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503af1c-df6e-4f6b-867c-a4e34d690276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:59.882919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503af1c-df6e-4f6b-867c-a4e34d690276 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:59.883195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503af1c-df6e-4f6b-867c-a4e34d690276 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:59.883499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503af1c-df6e-4f6b-867c-a4e34d690276 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:59.884188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503af1c-df6e-4f6b-867c-a4e34d690276 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:02:59.884493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503af1c-df6e-4f6b-867c-a4e34d690276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:59.886450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503af1c-df6e-4f6b-867c-a4e34d690276 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:59.891525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 495/999] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Jun 2 13:02:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:02:59.897452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503af1c-df6e-4f6b-867c-a4e34d690276 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:02:59.921051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed494057-ff3c-4950-ade9-b4347643a3fd None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:02:59.947846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:02:59.972661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1421d86-070a-481e-9e7f-ec86f7eca8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:02:59.973375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1421d86-070a-481e-9e7f-ec86f7eca8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:02:59.973662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1421d86-070a-481e-9e7f-ec86f7eca8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:02:59.973938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1421d86-070a-481e-9e7f-ec86f7eca8a4 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:02:59.974638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1421d86-070a-481e-9e7f-ec86f7eca8a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:02:59.976224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1421d86-070a-481e-9e7f-ec86f7eca8a4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:02:59.986177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 505/1000] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Jun 2 13:02:59 2022] GET /identity/v3/services => generated 1727 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:03:00.028536 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503af1c-df6e-4f6b-867c-a4e34d690276 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:00.072262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58024419-16e8-4315-953b-39085c6a7a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:00.072966 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58024419-16e8-4315-953b-39085c6a7a43 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:00.073252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58024419-16e8-4315-953b-39085c6a7a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:00.073538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58024419-16e8-4315-953b-39085c6a7a43 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:00.074278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58024419-16e8-4315-953b-39085c6a7a43 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:00.074587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58024419-16e8-4315-953b-39085c6a7a43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:00.076020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58024419-16e8-4315-953b-39085c6a7a43 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:00.082016 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 496/1001] 10.222.0.46 () {56 vars in 1122 bytes} [Thu Jun 2 13:02:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:00.087650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1421d86-070a-481e-9e7f-ec86f7eca8a4 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:00.125311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603fe03-27dc-4dce-89c3-fc613c8444b2 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:00.125915 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603fe03-27dc-4dce-89c3-fc613c8444b2 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:00.126201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603fe03-27dc-4dce-89c3-fc613c8444b2 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:00.127623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 497/1002] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:00.134783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d923ff-2f40-45bb-a875-e1947e426482 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:00.135074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d923ff-2f40-45bb-a875-e1947e426482 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:00.135403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d923ff-2f40-45bb-a875-e1947e426482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:00.157507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-99d923ff-2f40-45bb-a875-e1947e426482 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:00.158767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-99d923ff-2f40-45bb-a875-e1947e426482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:00.209590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1421d86-070a-481e-9e7f-ec86f7eca8a4 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:00.237689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:00.247166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cea163-8472-4912-a755-fd898b3e5f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:00.247842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cea163-8472-4912-a755-fd898b3e5f3d None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:00.248171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cea163-8472-4912-a755-fd898b3e5f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:00.248449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cea163-8472-4912-a755-fd898b3e5f3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:00.249185 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cea163-8472-4912-a755-fd898b3e5f3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:00.250559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cea163-8472-4912-a755-fd898b3e5f3d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:00.260051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 498/1003] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:00.277692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d923ff-2f40-45bb-a875-e1947e426482 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:00.312655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:00.364702 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 506/1004] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Jun 2 13:03:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:00.406610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d923ff-2f40-45bb-a875-e1947e426482 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:00.457435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932c3f4-be49-4a22-a439-9d5c1d5bcefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:00.458258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932c3f4-be49-4a22-a439-9d5c1d5bcefd None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:00.458539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932c3f4-be49-4a22-a439-9d5c1d5bcefd None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:00.458809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932c3f4-be49-4a22-a439-9d5c1d5bcefd None admin] PATH_INFO: `/v3/services/image` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:00.459472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932c3f4-be49-4a22-a439-9d5c1d5bcefd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:00.461020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932c3f4-be49-4a22-a439-9d5c1d5bcefd None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-7932c3f4-be49-4a22-a439-9d5c1d5bcefd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:00.473789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:00.474989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:03:00.475855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:00.480384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 499/1005] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Jun 2 13:03:00 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:00.481438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cea163-8472-4912-a755-fd898b3e5f3d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:00.609437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cea163-8472-4912-a755-fd898b3e5f3d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:00.656332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1feeb-6072-4b0e-920c-c457e4503868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:00.657268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1feeb-6072-4b0e-920c-c457e4503868 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:00.657701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1feeb-6072-4b0e-920c-c457e4503868 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:00.658129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1feeb-6072-4b0e-920c-c457e4503868 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:00.658989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1feeb-6072-4b0e-920c-c457e4503868 None admin] RBAC: Adding query filter params (name=image) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:00.659475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1feeb-6072-4b0e-920c-c457e4503868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:00.661052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1feeb-6072-4b0e-920c-c457e4503868 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:00.666553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 507/1006] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:00.674184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932c3f4-be49-4a22-a439-9d5c1d5bcefd None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:00.778432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:00.786245 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932c3f4-be49-4a22-a439-9d5c1d5bcefd None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:00.825278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539132d0-0cc5-4e1c-8c57-26b4f1a09d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:00.825955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539132d0-0cc5-4e1c-8c57-26b4f1a09d06 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:00.826243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539132d0-0cc5-4e1c-8c57-26b4f1a09d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:00.826522 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539132d0-0cc5-4e1c-8c57-26b4f1a09d06 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:00.827234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539132d0-0cc5-4e1c-8c57-26b4f1a09d06 None admin] RBAC: Adding query filter params (type=image) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:00.827542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539132d0-0cc5-4e1c-8c57-26b4f1a09d06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:00.828953 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539132d0-0cc5-4e1c-8c57-26b4f1a09d06 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:00.839897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 500/1007] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:02.267511 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d35d-3c48-467d-8301-dea240f43f51 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:02.268169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d35d-3c48-467d-8301-dea240f43f51 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:02.268169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d35d-3c48-467d-8301-dea240f43f51 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:02.269606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 508/1008] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:02.274884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dab5f5-45f6-4016-9fa1-797ce74c8c7f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:02.275372 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dab5f5-45f6-4016-9fa1-797ce74c8c7f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:02.275572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dab5f5-45f6-4016-9fa1-797ce74c8c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:02.292680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-60dab5f5-45f6-4016-9fa1-797ce74c8c7f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:02.293878 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-60dab5f5-45f6-4016-9fa1-797ce74c8c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:02.372414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 501/1009] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:02.395395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d35d-3c48-467d-8301-dea240f43f51 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:02.457785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:02.515030 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d35d-3c48-467d-8301-dea240f43f51 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:02.555224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438c94c-6b2f-418b-84e5-38f678ba0cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:02.555927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438c94c-6b2f-418b-84e5-38f678ba0cab None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:02.556219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438c94c-6b2f-418b-84e5-38f678ba0cab None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:02.557065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438c94c-6b2f-418b-84e5-38f678ba0cab None admin] PATH_INFO: `/v3/services/compute` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:02.557726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438c94c-6b2f-418b-84e5-38f678ba0cab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:02.559107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438c94c-6b2f-418b-84e5-38f678ba0cab None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-c438c94c-6b2f-418b-84e5-38f678ba0cab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:02.572224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:02.573492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:02.574334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 509/1010] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:03:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:02.579921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dab5f5-45f6-4016-9fa1-797ce74c8c7f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:02.680385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:02.682789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ec934-1263-4666-b27e-e6a41802b613 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:02.683083 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ec934-1263-4666-b27e-e6a41802b613 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:02.683370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ec934-1263-4666-b27e-e6a41802b613 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:02.685053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 510/1011] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:02.690517 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee5a30-402c-4e67-941e-0ac627131116 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:02.690809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee5a30-402c-4e67-941e-0ac627131116 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:02.691091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee5a30-402c-4e67-941e-0ac627131116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:02.695724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dab5f5-45f6-4016-9fa1-797ce74c8c7f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:02.708302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-26ee5a30-402c-4e67-941e-0ac627131116 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:02.709505 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-26ee5a30-402c-4e67-941e-0ac627131116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:02.730887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef19507-c95a-4ca9-acdb-0434a8a669c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:02.731592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef19507-c95a-4ca9-acdb-0434a8a669c4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:02.731900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef19507-c95a-4ca9-acdb-0434a8a669c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:02.732170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef19507-c95a-4ca9-acdb-0434a8a669c4 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:02.732862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef19507-c95a-4ca9-acdb-0434a8a669c4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:02.733165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef19507-c95a-4ca9-acdb-0434a8a669c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:02.734519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef19507-c95a-4ca9-acdb-0434a8a669c4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:02.739715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 502/1012] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:03:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:02.745200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef19507-c95a-4ca9-acdb-0434a8a669c4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:02.779322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 511/1013] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:02.804236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee5a30-402c-4e67-941e-0ac627131116 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:02.851498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:02.857570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef19507-c95a-4ca9-acdb-0434a8a669c4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:02.894541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d077-0056-44d7-85cf-afa31de031cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:02.896005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d077-0056-44d7-85cf-afa31de031cd None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:02.896742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d077-0056-44d7-85cf-afa31de031cd None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:02.897246 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515d077-0056-44d7-85cf-afa31de031cd None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:02.898651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d077-0056-44d7-85cf-afa31de031cd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:02.899302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d077-0056-44d7-85cf-afa31de031cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:02.901694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515d077-0056-44d7-85cf-afa31de031cd None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:02.912359 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 503/1014] 10.222.0.46 () {56 vars in 1112 bytes} [Thu Jun 2 13:03:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:02.912591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee5a30-402c-4e67-941e-0ac627131116 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:02.913688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d077-0056-44d7-85cf-afa31de031cd None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:02.934102 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:02.959411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c5160-b851-4ed0-8249-70ddb7071cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:02.960277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c5160-b851-4ed0-8249-70ddb7071cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:02.960555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c5160-b851-4ed0-8249-70ddb7071cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:02.960829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c5160-b851-4ed0-8249-70ddb7071cf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:02.962257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c5160-b851-4ed0-8249-70ddb7071cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:02.964326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c5160-b851-4ed0-8249-70ddb7071cf7 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:02.970851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 512/1015] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:02.972373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c5160-b851-4ed0-8249-70ddb7071cf7 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:03.030743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515d077-0056-44d7-85cf-afa31de031cd None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:03.074173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3801c-9bd8-4e00-8434-4290760ff5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:03.074841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3801c-9bd8-4e00-8434-4290760ff5d1 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:03.075123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3801c-9bd8-4e00-8434-4290760ff5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:03.075396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3801c-9bd8-4e00-8434-4290760ff5d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:03.076165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3801c-9bd8-4e00-8434-4290760ff5d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:03.077533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3801c-9bd8-4e00-8434-4290760ff5d1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:03.090321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c5160-b851-4ed0-8249-70ddb7071cf7 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:03.104668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:03.127746 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff194f-646a-4e6f-a4d3-f282ccede93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:03.128438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff194f-646a-4e6f-a4d3-f282ccede93b None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:03.128719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff194f-646a-4e6f-a4d3-f282ccede93b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:03.128990 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff194f-646a-4e6f-a4d3-f282ccede93b None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:03.129704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff194f-646a-4e6f-a4d3-f282ccede93b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:03.131130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff194f-646a-4e6f-a4d3-f282ccede93b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:03.151813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 504/1016] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Jun 2 13:03:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:03.153223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581468-45bf-4a09-93f7-e9b9c3bc8062 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:03.153512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581468-45bf-4a09-93f7-e9b9c3bc8062 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:03.153791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581468-45bf-4a09-93f7-e9b9c3bc8062 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:03.155402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 505/1017] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:03.161320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60ede-3716-47aa-b3bc-2068a887fcc3 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:03.161520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60ede-3716-47aa-b3bc-2068a887fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:03.161784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60ede-3716-47aa-b3bc-2068a887fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:03.180910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c9b60ede-3716-47aa-b3bc-2068a887fcc3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:03.187140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c9b60ede-3716-47aa-b3bc-2068a887fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:03.254866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 513/1018] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:03:02 2022] POST /identity/v3/projects => generated 311 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:03.269298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:03.278056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 506/1019] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:03 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:03.303327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff194f-646a-4e6f-a4d3-f282ccede93b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:03.430798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff194f-646a-4e6f-a4d3-f282ccede93b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:03.470767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaafa34-2e14-462c-a623-6f201f8a5a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:03.471479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaafa34-2e14-462c-a623-6f201f8a5a6d None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:03.471761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaafa34-2e14-462c-a623-6f201f8a5a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:03.472074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaafa34-2e14-462c-a623-6f201f8a5a6d None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:03.472834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaafa34-2e14-462c-a623-6f201f8a5a6d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:03.474215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaafa34-2e14-462c-a623-6f201f8a5a6d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:03.586942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 514/1020] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:03:03 2022] POST /identity/v3/services => generated 242 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:05.582043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8e1e0-9ceb-4de1-b88a-b7f8eb802814 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:05.582557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8e1e0-9ceb-4de1-b88a-b7f8eb802814 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:05.582668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8e1e0-9ceb-4de1-b88a-b7f8eb802814 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:05.584121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 507/1021] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:05.590167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c108f-7329-499d-81d6-8bfc02832479 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:05.590597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c108f-7329-499d-81d6-8bfc02832479 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:05.590791 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c108f-7329-499d-81d6-8bfc02832479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:05.602787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6b372-5902-4989-a97a-eeba4e5ec2b9 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:05.603148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6b372-5902-4989-a97a-eeba4e5ec2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:05.603432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6b372-5902-4989-a97a-eeba4e5ec2b9 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:05.604980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 508/1022] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:05.608795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-e11c108f-7329-499d-81d6-8bfc02832479 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:05.609826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e11c108f-7329-499d-81d6-8bfc02832479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:05.610029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea6ac-7ccd-46cb-b736-f33573574287 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:05.610323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea6ac-7ccd-46cb-b736-f33573574287 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:05.610605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea6ac-7ccd-46cb-b736-f33573574287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:05.628623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-33eea6ac-7ccd-46cb-b736-f33573574287 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:05.629816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-33eea6ac-7ccd-46cb-b736-f33573574287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:05.630625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:05.691746 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 515/1023] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:05.702386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 509/1024] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:05.716362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c108f-7329-499d-81d6-8bfc02832479 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:05.727252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea6ac-7ccd-46cb-b736-f33573574287 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:05.831595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c108f-7329-499d-81d6-8bfc02832479 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:05.838730 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea6ac-7ccd-46cb-b736-f33573574287 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:05.867887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:05.868079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f3d63-7004-4cb6-a50a-ca41e6df77b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:05.868925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f3d63-7004-4cb6-a50a-ca41e6df77b5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:05.869214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f3d63-7004-4cb6-a50a-ca41e6df77b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:05.869498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f3d63-7004-4cb6-a50a-ca41e6df77b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:05.875588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330b023-7fd9-47ce-bd28-bc20ab02aa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:05.876419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330b023-7fd9-47ce-bd28-bc20ab02aa7b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:05.876749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330b023-7fd9-47ce-bd28-bc20ab02aa7b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:05.876986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330b023-7fd9-47ce-bd28-bc20ab02aa7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:05.878155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330b023-7fd9-47ce-bd28-bc20ab02aa7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:05.879594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330b023-7fd9-47ce-bd28-bc20ab02aa7b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:05.879851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f3d63-7004-4cb6-a50a-ca41e6df77b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:03:05.881291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 510/1025] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:05.882528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d90b7-4454-44e9-a87f-2358ca0b8249 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:05.882814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d90b7-4454-44e9-a87f-2358ca0b8249 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:05.883091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d90b7-4454-44e9-a87f-2358ca0b8249 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:05.884550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 511/1026] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-c79f3d63-7004-4cb6-a50a-ca41e6df77b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:03:05.888262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:05.889201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:03:05.890063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:05.890704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d90b7-4454-44e9-a87f-2358ca0b8249 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:05.890776 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 516/1027] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Jun 2 13:03:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:05.892515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b00bc0-b42d-4e65-ab88-7a367c3ef282 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:05.892774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b00bc0-b42d-4e65-ab88-7a367c3ef282 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:05.893218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b00bc0-b42d-4e65-ab88-7a367c3ef282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:05.910231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-82b00bc0-b42d-4e65-ab88-7a367c3ef282 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:05.911428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-82b00bc0-b42d-4e65-ab88-7a367c3ef282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:05.914316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:05.977972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 517/1028] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:05.978753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b00bc0-b42d-4e65-ab88-7a367c3ef282 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:05.993629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d90b7-4454-44e9-a87f-2358ca0b8249 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:06.033090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2078c-f12f-4fb7-bdea-7f8dfad2e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:06.034143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2078c-f12f-4fb7-bdea-7f8dfad2e130 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:06.034428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2078c-f12f-4fb7-bdea-7f8dfad2e130 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:06.034765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2078c-f12f-4fb7-bdea-7f8dfad2e130 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:06.035646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2078c-f12f-4fb7-bdea-7f8dfad2e130 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:06.037106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2078c-f12f-4fb7-bdea-7f8dfad2e130 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:06.077673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b00bc0-b42d-4e65-ab88-7a367c3ef282 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:06.111496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817d4e-093e-428f-bc6c-e9ca3dc49742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:06.112204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817d4e-093e-428f-bc6c-e9ca3dc49742 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:06.112489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817d4e-093e-428f-bc6c-e9ca3dc49742 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:06.112767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817d4e-093e-428f-bc6c-e9ca3dc49742 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:06.113787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d817d4e-093e-428f-bc6c-e9ca3dc49742 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:06.114096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d817d4e-093e-428f-bc6c-e9ca3dc49742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:06.115481 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d817d4e-093e-428f-bc6c-e9ca3dc49742 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:06.123538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 518/1029] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Jun 2 13:03:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:06.124385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817d4e-093e-428f-bc6c-e9ca3dc49742 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:06.127044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:06.128665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 512/1030] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:03:05 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:06.134989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2078c-f12f-4fb7-bdea-7f8dfad2e130 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:06.192098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:06.246991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2078c-f12f-4fb7-bdea-7f8dfad2e130 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:06.262772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817d4e-093e-428f-bc6c-e9ca3dc49742 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:06.291154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859beb8d-d227-4ce5-a61f-acef1f757b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:06.292455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859beb8d-d227-4ce5-a61f-acef1f757b14 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:06.292927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859beb8d-d227-4ce5-a61f-acef1f757b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:06.293417 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859beb8d-d227-4ce5-a61f-acef1f757b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:06.299688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db91b5-8905-42c4-868e-8215f8736760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:06.300561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db91b5-8905-42c4-868e-8215f8736760 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:06.300845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db91b5-8905-42c4-868e-8215f8736760 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:06.301120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db91b5-8905-42c4-868e-8215f8736760 None admin] PATH_INFO: `/v3/services/image` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:06.301788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db91b5-8905-42c4-868e-8215f8736760 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:06.303206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db91b5-8905-42c4-868e-8215f8736760 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:06.307922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859beb8d-d227-4ce5-a61f-acef1f757b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:06.309632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859beb8d-d227-4ce5-a61f-acef1f757b14 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-10db91b5-8905-42c4-868e-8215f8736760 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:06.316216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:06.317561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:06.318435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 519/1031] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Jun 2 13:03:06 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:06.324326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db91b5-8905-42c4-868e-8215f8736760 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-859beb8d-d227-4ce5-a61f-acef1f757b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:03:06.335334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:06.336549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:06.337688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:03:06.337688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:03:06.337688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:06.337688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:06.337688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 513/1032] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:06.343165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859beb8d-d227-4ce5-a61f-acef1f757b14 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:06.409828 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:06.449613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db91b5-8905-42c4-868e-8215f8736760 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:06.462983 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859beb8d-d227-4ce5-a61f-acef1f757b14 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:06.466415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:06.490621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32515542-2edf-4c71-b97c-0cb5604c6e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:06.491305 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32515542-2edf-4c71-b97c-0cb5604c6e6e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:06.491593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32515542-2edf-4c71-b97c-0cb5604c6e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:06.491880 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32515542-2edf-4c71-b97c-0cb5604c6e6e None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:06.492619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32515542-2edf-4c71-b97c-0cb5604c6e6e None admin] RBAC: Adding query filter params (name=image) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:06.492934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32515542-2edf-4c71-b97c-0cb5604c6e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:06.494339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32515542-2edf-4c71-b97c-0cb5604c6e6e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:06.499482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 520/1033] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:06.505007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32515542-2edf-4c71-b97c-0cb5604c6e6e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:06.506390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af085-ba74-4fac-bb5b-8373d8d7331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:06.507072 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af085-ba74-4fac-bb5b-8373d8d7331d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:06.507355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af085-ba74-4fac-bb5b-8373d8d7331d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:06.507709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af085-ba74-4fac-bb5b-8373d8d7331d None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:06.508395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af085-ba74-4fac-bb5b-8373d8d7331d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:06.509483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af085-ba74-4fac-bb5b-8373d8d7331d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:06.510139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af085-ba74-4fac-bb5b-8373d8d7331d None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:06.523553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 514/1034] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:06.529524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af085-ba74-4fac-bb5b-8373d8d7331d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:06.618639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32515542-2edf-4c71-b97c-0cb5604c6e6e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:06.643588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af085-ba74-4fac-bb5b-8373d8d7331d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:06.652025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:06.660107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fdcbe-7e01-4987-9fba-04ba2da1d7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:06.660927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fdcbe-7e01-4987-9fba-04ba2da1d7cc None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:06.661217 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fdcbe-7e01-4987-9fba-04ba2da1d7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:06.661497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fdcbe-7e01-4987-9fba-04ba2da1d7cc None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:06.662221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fdcbe-7e01-4987-9fba-04ba2da1d7cc None admin] RBAC: Adding query filter params (type=image) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:06.662591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fdcbe-7e01-4987-9fba-04ba2da1d7cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:06.664057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fdcbe-7e01-4987-9fba-04ba2da1d7cc None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:06.673863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 521/1035] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:06.675304 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fdcbe-7e01-4987-9fba-04ba2da1d7cc None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:06.688992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e0f3-6e5d-44c8-850c-a42ab62f8aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:06.689894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e0f3-6e5d-44c8-850c-a42ab62f8aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:06.690387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e0f3-6e5d-44c8-850c-a42ab62f8aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:06.690509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e0f3-6e5d-44c8-850c-a42ab62f8aa2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:06.699260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2e0f3-6e5d-44c8-850c-a42ab62f8aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:06.700835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2e0f3-6e5d-44c8-850c-a42ab62f8aa2 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-e6f2e0f3-6e5d-44c8-850c-a42ab62f8aa2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:03:06.719778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:06.721269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:06.722608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 515/1036] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Jun 2 13:03:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:03:06.727283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e0f3-6e5d-44c8-850c-a42ab62f8aa2 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:06.756248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:06.798795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fdcbe-7e01-4987-9fba-04ba2da1d7cc None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:06.839345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740f91e-d04b-4679-a209-87608423c2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:06.839796 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f91e-d04b-4679-a209-87608423c2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:06.840083 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f91e-d04b-4679-a209-87608423c2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:06.840351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f91e-d04b-4679-a209-87608423c2c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:06.841203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740f91e-d04b-4679-a209-87608423c2c5 None admin] RBAC: Adding query filter params (interface=public, service_id=2a63144baf90446d8e8aab4e6b1ebfb8, region_id=RegionOne) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:06.841636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740f91e-d04b-4679-a209-87608423c2c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:06.842901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740f91e-d04b-4679-a209-87608423c2c5 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:06.843850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e0f3-6e5d-44c8-850c-a42ab62f8aa2 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:06.849629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 522/1037] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Jun 2 13:03:06 2022] GET /identity/v3/endpoints?service_id=2a63144baf90446d8e8aab4e6b1ebfb8&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:06.855770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740f91e-d04b-4679-a209-87608423c2c5 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:06.884932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4924301-9962-4c6e-9785-49256d2c6ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:06.885650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4924301-9962-4c6e-9785-49256d2c6ecc None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:06.885953 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4924301-9962-4c6e-9785-49256d2c6ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:06.886220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4924301-9962-4c6e-9785-49256d2c6ecc None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:06.887119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4924301-9962-4c6e-9785-49256d2c6ecc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:06.887431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4924301-9962-4c6e-9785-49256d2c6ecc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:06.888958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4924301-9962-4c6e-9785-49256d2c6ecc None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:06.926977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 516/1038] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Jun 2 13:03:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:06.928103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4924301-9962-4c6e-9785-49256d2c6ecc None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:06.941775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:06.995680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740f91e-d04b-4679-a209-87608423c2c5 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:07.020343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:07.034902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236b8a0-4a38-4f7d-80e9-b8384ccec9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:07.035668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4924301-9962-4c6e-9785-49256d2c6ecc None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:07.035788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236b8a0-4a38-4f7d-80e9-b8384ccec9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:07.046773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236b8a0-4a38-4f7d-80e9-b8384ccec9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:07.046773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236b8a0-4a38-4f7d-80e9-b8384ccec9f3 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:07.046773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236b8a0-4a38-4f7d-80e9-b8384ccec9f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:07.046773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236b8a0-4a38-4f7d-80e9-b8384ccec9f3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:07.047412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 523/1039] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Jun 2 13:03:06 2022] GET /identity/v3/services => generated 1957 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:03:07.146760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0b906-257f-46d6-8000-0e7e14edaf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:07.147440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0b906-257f-46d6-8000-0e7e14edaf7f None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:07.147720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0b906-257f-46d6-8000-0e7e14edaf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:07.148028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0b906-257f-46d6-8000-0e7e14edaf7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:07.279327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0b906-257f-46d6-8000-0e7e14edaf7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:07.280716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0b906-257f-46d6-8000-0e7e14edaf7f None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:07.364630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:07.385770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 517/1040] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:03:07.391910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236b8a0-4a38-4f7d-80e9-b8384ccec9f3 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:07.502472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236b8a0-4a38-4f7d-80e9-b8384ccec9f3 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:07.525468 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:07.538463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8d0ab-aa95-402d-86d7-c9360ffd362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:07.538463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8d0ab-aa95-402d-86d7-c9360ffd362d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:07.538463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8d0ab-aa95-402d-86d7-c9360ffd362d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:07.538796 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8d0ab-aa95-402d-86d7-c9360ffd362d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:07.552941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8d0ab-aa95-402d-86d7-c9360ffd362d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:07.554429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8d0ab-aa95-402d-86d7-c9360ffd362d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-54a8d0ab-aa95-402d-86d7-c9360ffd362d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:03:07.574047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:07.575016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:07.575936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:03:07.575936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:03:07.575936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:07.575936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:07.580225 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 524/1041] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:07.581219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0b906-257f-46d6-8000-0e7e14edaf7f None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:07.684600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0b906-257f-46d6-8000-0e7e14edaf7f None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:07.720198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e6342-733d-4d9b-b727-4b658acee2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:07.720870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e6342-733d-4d9b-b727-4b658acee2ca None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:07.721195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e6342-733d-4d9b-b727-4b658acee2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:07.721475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e6342-733d-4d9b-b727-4b658acee2ca None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:07.722183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e6342-733d-4d9b-b727-4b658acee2ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:07.722534 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e6342-733d-4d9b-b727-4b658acee2ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:07.723910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e6342-733d-4d9b-b727-4b658acee2ca None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:07.740067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 518/1042] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:07.741777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8d0ab-aa95-402d-86d7-c9360ffd362d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:07.849368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8d0ab-aa95-402d-86d7-c9360ffd362d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:07.885005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397bfc6-eede-4c7b-a060-518b3de09255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:07.885818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397bfc6-eede-4c7b-a060-518b3de09255 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:07.886105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397bfc6-eede-4c7b-a060-518b3de09255 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:07.886383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397bfc6-eede-4c7b-a060-518b3de09255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:07.893542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397bfc6-eede-4c7b-a060-518b3de09255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:07.895066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397bfc6-eede-4c7b-a060-518b3de09255 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-8397bfc6-eede-4c7b-a060-518b3de09255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:03:07.909761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:07.910717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:07.916433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:03:07.916433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:03:07.916433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:03:07.916433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:03:07.916433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:03:07.916433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:03:07.916433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:03:07.916433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:07.916433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 525/1043] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:03:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:07.918486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e6342-733d-4d9b-b727-4b658acee2ca None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:07.964382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:08.021580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e6342-733d-4d9b-b727-4b658acee2ca None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:08.054818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7d51c-940b-4d0f-8a26-adc39f3251f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:08.055487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7d51c-940b-4d0f-8a26-adc39f3251f1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:08.055768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7d51c-940b-4d0f-8a26-adc39f3251f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:08.056638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7d51c-940b-4d0f-8a26-adc39f3251f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:08.057423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7d51c-940b-4d0f-8a26-adc39f3251f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:08.057728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7d51c-940b-4d0f-8a26-adc39f3251f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:08.059153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7d51c-940b-4d0f-8a26-adc39f3251f1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:08.076957 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 519/1044] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:08.078601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397bfc6-eede-4c7b-a060-518b3de09255 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:08.114604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:08.190979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397bfc6-eede-4c7b-a060-518b3de09255 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:08.230479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d145-56c2-4221-bfc0-c98633206101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:08.231155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d145-56c2-4221-bfc0-c98633206101 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:08.231440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d145-56c2-4221-bfc0-c98633206101 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:08.231716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d145-56c2-4221-bfc0-c98633206101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:08.232591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70d145-56c2-4221-bfc0-c98633206101 None admin] RBAC: Adding query filter params (role.id=545468338c4445a78e84a2ad0660817c, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=ae1c6084061f4434864e9f7bcc553733) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:08.232907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70d145-56c2-4221-bfc0-c98633206101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:08.234355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70d145-56c2-4221-bfc0-c98633206101 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:08.247920 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 526/1045] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:03:08 2022] GET /identity/v3/role_assignments?user.id=ae1c6084061f4434864e9f7bcc553733&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=545468338c4445a78e84a2ad0660817c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:08.522590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417ae6-d5ce-435f-a570-6cb14510b6f7 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:08.522918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417ae6-d5ce-435f-a570-6cb14510b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:08.523155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417ae6-d5ce-435f-a570-6cb14510b6f7 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:08.525597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 520/1046] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:08.530478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb0f3b-32fc-4fe4-ab78-692b5a4ea00c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:08.530770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb0f3b-32fc-4fe4-ab78-692b5a4ea00c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:08.531049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb0f3b-32fc-4fe4-ab78-692b5a4ea00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:08.547799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4fcb0f3b-32fc-4fe4-ab78-692b5a4ea00c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:08.549039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4fcb0f3b-32fc-4fe4-ab78-692b5a4ea00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:08.624070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 527/1047] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:08.648086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417ae6-d5ce-435f-a570-6cb14510b6f7 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:08.764626 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417ae6-d5ce-435f-a570-6cb14510b6f7 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:08.766229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:08.799286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48bd6a-3649-4d05-b56c-08bee4e22229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:08.800134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48bd6a-3649-4d05-b56c-08bee4e22229 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:08.800419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48bd6a-3649-4d05-b56c-08bee4e22229 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:08.800725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48bd6a-3649-4d05-b56c-08bee4e22229 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:08.812274 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48bd6a-3649-4d05-b56c-08bee4e22229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-7a48bd6a-3649-4d05-b56c-08bee4e22229 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:03:08.820169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:08.821103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:08.822510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:08.823754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 521/1048] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:08.827915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb0f3b-32fc-4fe4-ab78-692b5a4ea00c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:08.856243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:08.934023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb0f3b-32fc-4fe4-ab78-692b5a4ea00c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:08.969129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd9df0-f242-449b-a552-78d392818e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:08.970087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd9df0-f242-449b-a552-78d392818e75 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:08.970519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd9df0-f242-449b-a552-78d392818e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:08.970938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd9df0-f242-449b-a552-78d392818e75 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:08.971844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd9df0-f242-449b-a552-78d392818e75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:08.972329 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd9df0-f242-449b-a552-78d392818e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:08.973864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd9df0-f242-449b-a552-78d392818e75 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:08.983813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 528/1049] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:08.989540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48bd6a-3649-4d05-b56c-08bee4e22229 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:09.099350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48bd6a-3649-4d05-b56c-08bee4e22229 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:09.138952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b069f0c-9efd-44a7-9bb5-e3b4a61bb483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:09.139829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b069f0c-9efd-44a7-9bb5-e3b4a61bb483 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:09.140173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b069f0c-9efd-44a7-9bb5-e3b4a61bb483 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:09.140456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b069f0c-9efd-44a7-9bb5-e3b4a61bb483 None admin] PATH_INFO: `/v3/users/800797ea294e4b34b8a89ae049aea9f3` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:09.154619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b069f0c-9efd-44a7-9bb5-e3b4a61bb483 None admin] RBAC: Authorizing `identity:get_user(user_id=800797ea294e4b34b8a89ae049aea9f3)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:09.156088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b069f0c-9efd-44a7-9bb5-e3b4a61bb483 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:09.158564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 522/1050] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:08 2022] GET /identity/v3/users/800797ea294e4b34b8a89ae049aea9f3 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:09.163533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd9df0-f242-449b-a552-78d392818e75 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:09.261877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:09.271843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd9df0-f242-449b-a552-78d392818e75 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:09.312780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ed89c-9fb1-4205-8d20-77374c55fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:09.313452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed89c-9fb1-4205-8d20-77374c55fea4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:09.313740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed89c-9fb1-4205-8d20-77374c55fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:09.314035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed89c-9fb1-4205-8d20-77374c55fea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:09.365016 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1394f-5562-4852-b816-22cc962bcac2 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:09.365375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1394f-5562-4852-b816-22cc962bcac2 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:09.365596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1394f-5562-4852-b816-22cc962bcac2 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:09.367128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 523/1051] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:03:09.373618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c66367-8457-463d-885f-2724f356acf7 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:09.373912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c66367-8457-463d-885f-2724f356acf7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:09.374187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c66367-8457-463d-885f-2724f356acf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:09.394080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ed89c-9fb1-4205-8d20-77374c55fea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:09.394297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ed89c-9fb1-4205-8d20-77374c55fea4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:09.396819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-60c66367-8457-463d-885f-2724f356acf7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:09.398025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-60c66367-8457-463d-885f-2724f356acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:09.413131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:09.472687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 524/1052] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:09.493042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:09.496268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c66367-8457-463d-885f-2724f356acf7 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:09.505720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 529/1053] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:03:09.511326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ed89c-9fb1-4205-8d20-77374c55fea4 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:09.598846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c66367-8457-463d-885f-2724f356acf7 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:09.631947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ed89c-9fb1-4205-8d20-77374c55fea4 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:09.640242 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320adc3f-f41b-4d49-8e3b-9243f01fada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:09.641038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320adc3f-f41b-4d49-8e3b-9243f01fada7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:09.641322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320adc3f-f41b-4d49-8e3b-9243f01fada7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:09.641597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320adc3f-f41b-4d49-8e3b-9243f01fada7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:09.642253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320adc3f-f41b-4d49-8e3b-9243f01fada7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:09.643609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320adc3f-f41b-4d49-8e3b-9243f01fada7 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-320adc3f-f41b-4d49-8e3b-9243f01fada7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:09.655150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:09.656220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:09.657055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 525/1054] 10.222.0.46 () {56 vars in 1105 bytes} [Thu Jun 2 13:03:09 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:03:09.662274 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320adc3f-f41b-4d49-8e3b-9243f01fada7 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:09.678537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda4876-75e5-4a2c-a54d-64721a7e77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:09.679403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4876-75e5-4a2c-a54d-64721a7e77b6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:09.679685 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4876-75e5-4a2c-a54d-64721a7e77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:09.680005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4876-75e5-4a2c-a54d-64721a7e77b6 None admin] PATH_INFO: `/v3/projects/767e552be00c469aa39627e04f587b89` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:09.681732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4876-75e5-4a2c-a54d-64721a7e77b6 None admin] RBAC: Authorizing `identity:get_project(project_id=767e552be00c469aa39627e04f587b89)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:09.683161 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4876-75e5-4a2c-a54d-64721a7e77b6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:09.685067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 530/1055] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:03:09 2022] GET /identity/v3/projects/767e552be00c469aa39627e04f587b89 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:09.687986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:09.690808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda4876-75e5-4a2c-a54d-64721a7e77b6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:09.751794 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:09.779972 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320adc3f-f41b-4d49-8e3b-9243f01fada7 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:09.796302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda4876-75e5-4a2c-a54d-64721a7e77b6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:09.820373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d1e5-1ae3-40af-b297-115d368be703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:09.821965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d1e5-1ae3-40af-b297-115d368be703 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:09.822457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d1e5-1ae3-40af-b297-115d368be703 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:09.823078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d1e5-1ae3-40af-b297-115d368be703 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:09.824496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d1e5-1ae3-40af-b297-115d368be703 None admin] RBAC: Adding query filter params (name=image) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:09.825089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d1e5-1ae3-40af-b297-115d368be703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:09.827313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d1e5-1ae3-40af-b297-115d368be703 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:09.839198 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e79db-bd1c-4002-bfa8-2c740995ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:09.839912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e79db-bd1c-4002-bfa8-2c740995ce19 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:09.840189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e79db-bd1c-4002-bfa8-2c740995ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:09.840467 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e79db-bd1c-4002-bfa8-2c740995ce19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:09.840937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 526/1056] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:09.844515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e79db-bd1c-4002-bfa8-2c740995ce19 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=767e552be00c469aa39627e04f587b89, user.id=800797ea294e4b34b8a89ae049aea9f3) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:09.844839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e79db-bd1c-4002-bfa8-2c740995ce19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:09.846316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e79db-bd1c-4002-bfa8-2c740995ce19 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:09.846428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d1e5-1ae3-40af-b297-115d368be703 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:09.860235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 531/1057] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:03:09 2022] GET /identity/v3/role_assignments?user.id=800797ea294e4b34b8a89ae049aea9f3&scope.project.id=767e552be00c469aa39627e04f587b89&role.id=31c5600d1f984a04827cf0052fc61678 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:09.945184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:09.968655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d1e5-1ae3-40af-b297-115d368be703 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:10.007908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1633c9-262e-4bce-b9c1-2aa2791e2f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:10.008638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1633c9-262e-4bce-b9c1-2aa2791e2f2a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:10.008926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1633c9-262e-4bce-b9c1-2aa2791e2f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:10.009243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1633c9-262e-4bce-b9c1-2aa2791e2f2a None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:10.009986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1633c9-262e-4bce-b9c1-2aa2791e2f2a None admin] RBAC: Adding query filter params (type=image) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:10.010301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1633c9-262e-4bce-b9c1-2aa2791e2f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:10.011739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1633c9-262e-4bce-b9c1-2aa2791e2f2a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:10.023769 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 527/1058] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:10.024009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e79db-bd1c-4002-bfa8-2c740995ce19 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:10.128951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e79db-bd1c-4002-bfa8-2c740995ce19 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:10.152112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:10.164497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7d23a-b390-4cbd-94b6-30f192c3fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:10.165170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d23a-b390-4cbd-94b6-30f192c3fda3 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:10.166020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d23a-b390-4cbd-94b6-30f192c3fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:10.166410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d23a-b390-4cbd-94b6-30f192c3fda3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:10.167153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7d23a-b390-4cbd-94b6-30f192c3fda3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:10.168553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7d23a-b390-4cbd-94b6-30f192c3fda3 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:10.287564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 532/1059] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Jun 2 13:03:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:10.540872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b04794-c61c-41bd-add1-1d25a8eedb4b None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:10.541164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b04794-c61c-41bd-add1-1d25a8eedb4b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:10.541471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b04794-c61c-41bd-add1-1d25a8eedb4b None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:10.542857 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 528/1060] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:10.548820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd461b-0645-4197-a315-29606623a40a None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:10.551341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd461b-0645-4197-a315-29606623a40a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:10.551341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd461b-0645-4197-a315-29606623a40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:10.568731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-64dd461b-0645-4197-a315-29606623a40a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:10.569987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-64dd461b-0645-4197-a315-29606623a40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:10.651993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 533/1061] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:10.672432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b04794-c61c-41bd-add1-1d25a8eedb4b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:10.783078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b04794-c61c-41bd-add1-1d25a8eedb4b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:10.817881 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e6c68-4909-43d6-a951-454dd66267ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:10.818711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6c68-4909-43d6-a951-454dd66267ce None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:10.819017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6c68-4909-43d6-a951-454dd66267ce None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:10.819268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6c68-4909-43d6-a951-454dd66267ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:10.830582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e6c68-4909-43d6-a951-454dd66267ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-c49e6c68-4909-43d6-a951-454dd66267ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:03:10.839222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:10.840217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:10.841093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 529/1062] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Jun 2 13:03:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:10.846517 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd461b-0645-4197-a315-29606623a40a None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:10.949003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd461b-0645-4197-a315-29606623a40a None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:10.951355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:10.988123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dc193-ac88-47e9-990b-47214a602322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:10.988911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dc193-ac88-47e9-990b-47214a602322 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:10.989196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dc193-ac88-47e9-990b-47214a602322 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:10.989699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dc193-ac88-47e9-990b-47214a602322 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:10.990644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dc193-ac88-47e9-990b-47214a602322 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:10.990993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dc193-ac88-47e9-990b-47214a602322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:10.992927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dc193-ac88-47e9-990b-47214a602322 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:11.006925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 534/1063] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Jun 2 13:03:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:11.008308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e6c68-4909-43d6-a951-454dd66267ce None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:11.011413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:11.111755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e6c68-4909-43d6-a951-454dd66267ce None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:11.147783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46ffaf-a20d-40ae-b887-c908cfeb6011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:11.148598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ffaf-a20d-40ae-b887-c908cfeb6011 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:11.148877 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ffaf-a20d-40ae-b887-c908cfeb6011 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:11.149150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ffaf-a20d-40ae-b887-c908cfeb6011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:11.160622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46ffaf-a20d-40ae-b887-c908cfeb6011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:11.162081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46ffaf-a20d-40ae-b887-c908cfeb6011 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-4c46ffaf-a20d-40ae-b887-c908cfeb6011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:03:11.181054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:11.182061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:11.188771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:03:11.188771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:03:11.188771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:11.188771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:11.188771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 530/1064] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:11.189061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dc193-ac88-47e9-990b-47214a602322 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:11.291632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dc193-ac88-47e9-990b-47214a602322 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:11.325369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e534ecd-0d4e-4435-9224-6852aa9647ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:11.326360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e534ecd-0d4e-4435-9224-6852aa9647ef None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:11.326812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e534ecd-0d4e-4435-9224-6852aa9647ef None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:11.327277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e534ecd-0d4e-4435-9224-6852aa9647ef None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:11.328214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e534ecd-0d4e-4435-9224-6852aa9647ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:11.328694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e534ecd-0d4e-4435-9224-6852aa9647ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:11.330283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e534ecd-0d4e-4435-9224-6852aa9647ef None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:11.343468 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 535/1065] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:11.348879 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46ffaf-a20d-40ae-b887-c908cfeb6011 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:11.413220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:11.461535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46ffaf-a20d-40ae-b887-c908cfeb6011 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:11.499147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98639ebb-14dd-466b-97c5-0582ca05a6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:11.499991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98639ebb-14dd-466b-97c5-0582ca05a6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:11.500283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98639ebb-14dd-466b-97c5-0582ca05a6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:11.500564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98639ebb-14dd-466b-97c5-0582ca05a6c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:11.508291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98639ebb-14dd-466b-97c5-0582ca05a6c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:11.510279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98639ebb-14dd-466b-97c5-0582ca05a6c6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-98639ebb-14dd-466b-97c5-0582ca05a6c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:03:11.524449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:11.525997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:11.526938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:11.526938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:11.526938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:03:11.526938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:03:11.526938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:03:11.526938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:03:11.526938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:03:11.526938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:03:11.526938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:03:11.526938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:11.530976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 531/1066] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Jun 2 13:03:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:03:11.532224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e534ecd-0d4e-4435-9224-6852aa9647ef None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:11.561352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:11.635795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e534ecd-0d4e-4435-9224-6852aa9647ef None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:11.671658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d44c06-d61a-4fba-bd0c-c99e2f737621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:11.672424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d44c06-d61a-4fba-bd0c-c99e2f737621 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:11.672706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d44c06-d61a-4fba-bd0c-c99e2f737621 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:11.672994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d44c06-d61a-4fba-bd0c-c99e2f737621 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:11.673975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d44c06-d61a-4fba-bd0c-c99e2f737621 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:11.674308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d44c06-d61a-4fba-bd0c-c99e2f737621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:11.676526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d44c06-d61a-4fba-bd0c-c99e2f737621 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:11.701173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 536/1067] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Jun 2 13:03:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:11.702643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98639ebb-14dd-466b-97c5-0582ca05a6c6 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:11.801493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98639ebb-14dd-466b-97c5-0582ca05a6c6 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:11.816225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:11.839097 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaa667-099d-4007-9144-de356ec5b75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:11.839933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaa667-099d-4007-9144-de356ec5b75c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:11.840216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaa667-099d-4007-9144-de356ec5b75c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:11.840503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaa667-099d-4007-9144-de356ec5b75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:11.851918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eaa667-099d-4007-9144-de356ec5b75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:11.854365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eaa667-099d-4007-9144-de356ec5b75c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-43eaa667-099d-4007-9144-de356ec5b75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:03:11.872375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:11.873352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:11.880684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:03:11.880684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:03:11.880684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:11.880684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:11.880684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 532/1068] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:03:11.880998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d44c06-d61a-4fba-bd0c-c99e2f737621 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:11.967356 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:11.985209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d44c06-d61a-4fba-bd0c-c99e2f737621 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:12.021013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81641b17-6ca5-4487-bbd1-ddcd362209f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:12.021697 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81641b17-6ca5-4487-bbd1-ddcd362209f0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.021979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81641b17-6ca5-4487-bbd1-ddcd362209f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.022251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81641b17-6ca5-4487-bbd1-ddcd362209f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.022982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81641b17-6ca5-4487-bbd1-ddcd362209f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:12.023291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81641b17-6ca5-4487-bbd1-ddcd362209f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:12.025250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81641b17-6ca5-4487-bbd1-ddcd362209f0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:12.041554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 537/1069] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:12.043066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaa667-099d-4007-9144-de356ec5b75c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:12.148807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaa667-099d-4007-9144-de356ec5b75c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:12.152140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0985772-a3b9-4940-adf1-b48c95794048 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.152433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0985772-a3b9-4940-adf1-b48c95794048 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.152724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0985772-a3b9-4940-adf1-b48c95794048 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.154282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 538/1070] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:12.159398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07db3d-22c9-4cb7-8f83-f4c9481d6af0 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.159685 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07db3d-22c9-4cb7-8f83-f4c9481d6af0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.159994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07db3d-22c9-4cb7-8f83-f4c9481d6af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.177314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ee07db3d-22c9-4cb7-8f83-f4c9481d6af0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:12.178524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ee07db3d-22c9-4cb7-8f83-f4c9481d6af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:12.189395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3796-42dc-45d8-8440-f6a64cbc29c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:12.190686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3796-42dc-45d8-8440-f6a64cbc29c9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.191306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3796-42dc-45d8-8440-f6a64cbc29c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.191649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3796-42dc-45d8-8440-f6a64cbc29c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.201867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac3796-42dc-45d8-8440-f6a64cbc29c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:12.203966 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac3796-42dc-45d8-8440-f6a64cbc29c9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-12ac3796-42dc-45d8-8440-f6a64cbc29c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:03:12.224063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:12.225234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:12.226375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:03:12.226375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:03:12.226375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:03:12.226375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:03:12.226375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:03:12.226375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:03:12.226375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:03:12.226375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:12.227278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 533/1071] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:12.231852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3796-42dc-45d8-8440-f6a64cbc29c9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:12.260883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:12.264199 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 539/1072] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:12.279522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07db3d-22c9-4cb7-8f83-f4c9481d6af0 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:12.342299 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3796-42dc-45d8-8440-f6a64cbc29c9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:12.369915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:12.382124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff133c85-1948-4bf5-8fb6-da16f89d3d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:12.382796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff133c85-1948-4bf5-8fb6-da16f89d3d99 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.383080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff133c85-1948-4bf5-8fb6-da16f89d3d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.383356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff133c85-1948-4bf5-8fb6-da16f89d3d99 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.384759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff133c85-1948-4bf5-8fb6-da16f89d3d99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:12.385070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff133c85-1948-4bf5-8fb6-da16f89d3d99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:12.386507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff133c85-1948-4bf5-8fb6-da16f89d3d99 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:12.398695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 534/1073] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:12.404629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff133c85-1948-4bf5-8fb6-da16f89d3d99 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:12.413114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07db3d-22c9-4cb7-8f83-f4c9481d6af0 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:12.450568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dcdf0-8b2b-466f-a24d-735e0124e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:12.451380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dcdf0-8b2b-466f-a24d-735e0124e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.451667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dcdf0-8b2b-466f-a24d-735e0124e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.451972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dcdf0-8b2b-466f-a24d-735e0124e0e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.463587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dcdf0-8b2b-466f-a24d-735e0124e0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-d37dcdf0-8b2b-466f-a24d-735e0124e0e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:03:12.471403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:12.472396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:12.473234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 540/1074] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:03:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:03:12.478597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dcdf0-8b2b-466f-a24d-735e0124e0e0 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:12.499067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:12.516028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff133c85-1948-4bf5-8fb6-da16f89d3d99 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:12.553506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7147f2e-09bd-4834-a4a9-d86e1fdda0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:12.554693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147f2e-09bd-4834-a4a9-d86e1fdda0a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.554693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147f2e-09bd-4834-a4a9-d86e1fdda0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.554961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7147f2e-09bd-4834-a4a9-d86e1fdda0a4 None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/ae1c6084061f4434864e9f7bcc553733/roles/545468338c4445a78e84a2ad0660817c` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.557900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7147f2e-09bd-4834-a4a9-d86e1fdda0a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=ae1c6084061f4434864e9f7bcc553733, role_id=545468338c4445a78e84a2ad0660817c)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:12.559382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7147f2e-09bd-4834-a4a9-d86e1fdda0a4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:12.586433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dcdf0-8b2b-466f-a24d-735e0124e0e0 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:12.622046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350204a-d1c6-4c15-a7bf-7b0b0e2cf630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:12.622798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350204a-d1c6-4c15-a7bf-7b0b0e2cf630 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.623063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350204a-d1c6-4c15-a7bf-7b0b0e2cf630 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.623314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350204a-d1c6-4c15-a7bf-7b0b0e2cf630 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.624105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350204a-d1c6-4c15-a7bf-7b0b0e2cf630 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:12.624419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350204a-d1c6-4c15-a7bf-7b0b0e2cf630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:12.625810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350204a-d1c6-4c15-a7bf-7b0b0e2cf630 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:12.627305 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:12.632375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 535/1075] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:03:12 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/ae1c6084061f4434864e9f7bcc553733/roles/545468338c4445a78e84a2ad0660817c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:03:12.635523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 541/1076] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:12.641674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7147f2e-09bd-4834-a4a9-d86e1fdda0a4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:12.647957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3908d7-0434-4fb7-b203-5a69a0bb1e92 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.648246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3908d7-0434-4fb7-b203-5a69a0bb1e92 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.648535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3908d7-0434-4fb7-b203-5a69a0bb1e92 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.650488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 542/1077] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:03:12.657206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e5b2c-f189-4507-8d32-68362c75a782 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.657405 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e5b2c-f189-4507-8d32-68362c75a782 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.657670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e5b2c-f189-4507-8d32-68362c75a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.677271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7e1e5b2c-f189-4507-8d32-68362c75a782 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:12.678518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7e1e5b2c-f189-4507-8d32-68362c75a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:12.759675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 543/1078] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:12.761761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7147f2e-09bd-4834-a4a9-d86e1fdda0a4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:12.782923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e5b2c-f189-4507-8d32-68362c75a782 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:12.801746 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccca221-8940-4248-bc82-ed260c413f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:12.802659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccca221-8940-4248-bc82-ed260c413f18 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.802937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccca221-8940-4248-bc82-ed260c413f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.803206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccca221-8940-4248-bc82-ed260c413f18 None admin] PATH_INFO: `/v3/users/800797ea294e4b34b8a89ae049aea9f3` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.804577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccca221-8940-4248-bc82-ed260c413f18 None admin] RBAC: Authorizing `identity:get_user(user_id=800797ea294e4b34b8a89ae049aea9f3)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:12.806089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccca221-8940-4248-bc82-ed260c413f18 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:12.812771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 536/1079] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:12 2022] GET /identity/v3/users/800797ea294e4b34b8a89ae049aea9f3 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:12.814024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccca221-8940-4248-bc82-ed260c413f18 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:12.833723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:12.901698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e5b2c-f189-4507-8d32-68362c75a782 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:12.929486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccca221-8940-4248-bc82-ed260c413f18 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:12.929696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:12.938664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e29236-ed73-4721-a8a7-8fc80a0d2d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:12.939333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29236-ed73-4721-a8a7-8fc80a0d2d91 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.947676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29236-ed73-4721-a8a7-8fc80a0d2d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.947676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29236-ed73-4721-a8a7-8fc80a0d2d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.965831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6117c-0961-4f16-bc08-e85b0cf79696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:12.966701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6117c-0961-4f16-bc08-e85b0cf79696 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:12.966979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6117c-0961-4f16-bc08-e85b0cf79696 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:12.967258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6117c-0961-4f16-bc08-e85b0cf79696 None admin] PATH_INFO: `/v3/projects/767e552be00c469aa39627e04f587b89` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:12.968499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6117c-0961-4f16-bc08-e85b0cf79696 None admin] RBAC: Authorizing `identity:get_project(project_id=767e552be00c469aa39627e04f587b89)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:12.969927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6117c-0961-4f16-bc08-e85b0cf79696 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:12.976453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 537/1080] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:03:12 2022] GET /identity/v3/projects/767e552be00c469aa39627e04f587b89 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:12.977504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6117c-0961-4f16-bc08-e85b0cf79696 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:13.028612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e29236-ed73-4721-a8a7-8fc80a0d2d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:13.030072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e29236-ed73-4721-a8a7-8fc80a0d2d91 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:13.066488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:13.085022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6117c-0961-4f16-bc08-e85b0cf79696 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:13.122535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d806668-d402-45d1-92d9-cd7ca12af006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:13.123440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806668-d402-45d1-92d9-cd7ca12af006 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:13.123715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806668-d402-45d1-92d9-cd7ca12af006 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:13.124027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806668-d402-45d1-92d9-cd7ca12af006 None admin] PATH_INFO: `/v3/projects/767e552be00c469aa39627e04f587b89/users/800797ea294e4b34b8a89ae049aea9f3/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:13.126083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d806668-d402-45d1-92d9-cd7ca12af006 None admin] RBAC: Authorizing `identity:create_grant(project_id=767e552be00c469aa39627e04f587b89, user_id=800797ea294e4b34b8a89ae049aea9f3, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:13.127526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d806668-d402-45d1-92d9-cd7ca12af006 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:13.139552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 544/1081] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:03:13.145444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e29236-ed73-4721-a8a7-8fc80a0d2d91 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:13.172178 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:13.187432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 538/1082] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:03:12 2022] PUT /identity/v3/projects/767e552be00c469aa39627e04f587b89/users/800797ea294e4b34b8a89ae049aea9f3/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:03:13.268803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e29236-ed73-4721-a8a7-8fc80a0d2d91 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:13.307416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ee8d1-9046-44dd-b8cd-e72dd0b3db3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:13.308300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ee8d1-9046-44dd-b8cd-e72dd0b3db3c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:13.308582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ee8d1-9046-44dd-b8cd-e72dd0b3db3c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:13.308881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ee8d1-9046-44dd-b8cd-e72dd0b3db3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:13.320949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ee8d1-9046-44dd-b8cd-e72dd0b3db3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:13.322999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ee8d1-9046-44dd-b8cd-e72dd0b3db3c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-b62ee8d1-9046-44dd-b8cd-e72dd0b3db3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:03:13.342428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:13.343518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:13.344462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:03:13.344462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:03:13.344462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:13.344462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:13.348339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 545/1083] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:03:13.349859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d806668-d402-45d1-92d9-cd7ca12af006 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:13.470553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d806668-d402-45d1-92d9-cd7ca12af006 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:13.506385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dd18b-af6d-4fab-b24e-82e2a8a113dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:13.507057 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dd18b-af6d-4fab-b24e-82e2a8a113dc None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:13.507338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dd18b-af6d-4fab-b24e-82e2a8a113dc None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:13.507615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dd18b-af6d-4fab-b24e-82e2a8a113dc None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:13.508393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dd18b-af6d-4fab-b24e-82e2a8a113dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:13.508702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dd18b-af6d-4fab-b24e-82e2a8a113dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:13.510734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dd18b-af6d-4fab-b24e-82e2a8a113dc None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:13.524269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 539/1084] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:14.938538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb4406-814f-4757-8ac6-63e5ec7fbbc3 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:14.939109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb4406-814f-4757-8ac6-63e5ec7fbbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:14.939109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb4406-814f-4757-8ac6-63e5ec7fbbc3 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:14.940741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 546/1085] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:14.947159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864387-903f-4232-b026-f08268db0761 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:14.947678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864387-903f-4232-b026-f08268db0761 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:14.947795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864387-903f-4232-b026-f08268db0761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:14.952718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:14.967946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-99864387-903f-4232-b026-f08268db0761 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:14.969844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-99864387-903f-4232-b026-f08268db0761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:15.055031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 540/1086] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:15.078957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb4406-814f-4757-8ac6-63e5ec7fbbc3 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:15.160288 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:15.182624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb4406-814f-4757-8ac6-63e5ec7fbbc3 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:15.216235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043d97b-018b-42e4-bdae-8104c33a1c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:15.216980 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043d97b-018b-42e4-bdae-8104c33a1c98 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:15.217260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043d97b-018b-42e4-bdae-8104c33a1c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:15.217531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043d97b-018b-42e4-bdae-8104c33a1c98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:15.227190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043d97b-018b-42e4-bdae-8104c33a1c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-6043d97b-018b-42e4-bdae-8104c33a1c98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:03:15.235256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:15.236224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:15.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 547/1087] 10.222.0.46 () {56 vars in 1120 bytes} [Thu Jun 2 13:03:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:15.243129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99864387-903f-4232-b026-f08268db0761 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:15.339345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99864387-903f-4232-b026-f08268db0761 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:15.369064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:15.373967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e986e40-6094-4dd9-9567-23e266e98292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:15.374633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986e40-6094-4dd9-9567-23e266e98292 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:15.374916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986e40-6094-4dd9-9567-23e266e98292 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:15.375195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e986e40-6094-4dd9-9567-23e266e98292 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:15.375969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e986e40-6094-4dd9-9567-23e266e98292 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:15.376273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e986e40-6094-4dd9-9567-23e266e98292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:15.377671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e986e40-6094-4dd9-9567-23e266e98292 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:15.386381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 541/1088] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Jun 2 13:03:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:15.392350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043d97b-018b-42e4-bdae-8104c33a1c98 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:15.464807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22a881-7973-4b8a-8b20-cd0aea47ffb2 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:15.465103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22a881-7973-4b8a-8b20-cd0aea47ffb2 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:15.465382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22a881-7973-4b8a-8b20-cd0aea47ffb2 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:15.466792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 542/1089] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:15.471934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e20e8a-a810-4b7f-91d0-4548af337ea5 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:15.472225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e20e8a-a810-4b7f-91d0-4548af337ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:15.472503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e20e8a-a810-4b7f-91d0-4548af337ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:15.489445 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-94e20e8a-a810-4b7f-91d0-4548af337ea5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:15.490628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-94e20e8a-a810-4b7f-91d0-4548af337ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:15.491601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043d97b-018b-42e4-bdae-8104c33a1c98 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:15.524617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70918e19-b6d0-470f-8b43-e539cf2dacb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:15.525413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70918e19-b6d0-470f-8b43-e539cf2dacb1 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:15.525695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70918e19-b6d0-470f-8b43-e539cf2dacb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:15.525971 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70918e19-b6d0-470f-8b43-e539cf2dacb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:15.532847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:15.536822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70918e19-b6d0-470f-8b43-e539cf2dacb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:15.538270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70918e19-b6d0-470f-8b43-e539cf2dacb1 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-70918e19-b6d0-470f-8b43-e539cf2dacb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:03:15.555324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:15.556844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:15.557730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:03:15.557730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:03:15.557730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:15.557730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:15.557950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 543/1090] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:15.558022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 548/1091] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:15.562528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e20e8a-a810-4b7f-91d0-4548af337ea5 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:15.581389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70918e19-b6d0-470f-8b43-e539cf2dacb1 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:15.659802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e20e8a-a810-4b7f-91d0-4548af337ea5 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:15.678594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70918e19-b6d0-470f-8b43-e539cf2dacb1 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:15.683146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:15.693499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7b704-33b4-420b-8376-32586c101257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:15.694165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b704-33b4-420b-8376-32586c101257 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:15.694449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b704-33b4-420b-8376-32586c101257 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:15.694728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b704-33b4-420b-8376-32586c101257 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:15.695448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7b704-33b4-420b-8376-32586c101257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:15.695754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7b704-33b4-420b-8376-32586c101257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:15.697729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7b704-33b4-420b-8376-32586c101257 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:15.708626 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 544/1092] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:15.712619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc55aa6-0d60-46c8-959e-890c78314f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:15.713412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc55aa6-0d60-46c8-959e-890c78314f9f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:15.713691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc55aa6-0d60-46c8-959e-890c78314f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:15.713960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc55aa6-0d60-46c8-959e-890c78314f9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:15.714435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7b704-33b4-420b-8376-32586c101257 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:15.724023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc55aa6-0d60-46c8-959e-890c78314f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-dfc55aa6-0d60-46c8-959e-890c78314f9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:03:15.731969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:15.732927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:15.733840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 549/1093] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:03:15.739191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc55aa6-0d60-46c8-959e-890c78314f9f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:15.791814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:15.814270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7b704-33b4-420b-8376-32586c101257 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:15.843733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc55aa6-0d60-46c8-959e-890c78314f9f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:15.849528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550daefd-4f93-4296-92a8-d19eb19d40c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:15.850327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550daefd-4f93-4296-92a8-d19eb19d40c9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:15.850610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550daefd-4f93-4296-92a8-d19eb19d40c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:15.850889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550daefd-4f93-4296-92a8-d19eb19d40c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:15.858845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550daefd-4f93-4296-92a8-d19eb19d40c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:15.860315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550daefd-4f93-4296-92a8-d19eb19d40c9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-550daefd-4f93-4296-92a8-d19eb19d40c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:03:15.874298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:15.875459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:15.876604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 545/1094] 10.222.0.46 () {56 vars in 1093 bytes} [Thu Jun 2 13:03:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:15.880002 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e247b-63bd-4abf-8b8c-7e563015b056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:15.880690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e247b-63bd-4abf-8b8c-7e563015b056 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:15.880976 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e247b-63bd-4abf-8b8c-7e563015b056 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:15.881255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e247b-63bd-4abf-8b8c-7e563015b056 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:15.881356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550daefd-4f93-4296-92a8-d19eb19d40c9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:15.882010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e247b-63bd-4abf-8b8c-7e563015b056 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:15.882318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e247b-63bd-4abf-8b8c-7e563015b056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:15.884209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e247b-63bd-4abf-8b8c-7e563015b056 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:15.892808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 550/1095] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:15.898473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e247b-63bd-4abf-8b8c-7e563015b056 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:15.933565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:15.998616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550daefd-4f93-4296-92a8-d19eb19d40c9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:15.999671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e247b-63bd-4abf-8b8c-7e563015b056 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:16.012808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:16.032177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d85ad-8ed7-4d03-8036-d578e7afc49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:16.032686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92572645-1285-446a-bec8-1be0c5455664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:16.032854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d85ad-8ed7-4d03-8036-d578e7afc49a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:16.033144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d85ad-8ed7-4d03-8036-d578e7afc49a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:16.033424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d85ad-8ed7-4d03-8036-d578e7afc49a None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:16.033558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92572645-1285-446a-bec8-1be0c5455664 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:16.033845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92572645-1285-446a-bec8-1be0c5455664 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:16.034119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92572645-1285-446a-bec8-1be0c5455664 None admin] PATH_INFO: `/v3/users/800797ea294e4b34b8a89ae049aea9f3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:16.034261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d85ad-8ed7-4d03-8036-d578e7afc49a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:16.034574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d85ad-8ed7-4d03-8036-d578e7afc49a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:16.035300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92572645-1285-446a-bec8-1be0c5455664 None admin] RBAC: Authorizing `identity:get_user(user_id=800797ea294e4b34b8a89ae049aea9f3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:16.036032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d85ad-8ed7-4d03-8036-d578e7afc49a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:16.036748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92572645-1285-446a-bec8-1be0c5455664 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:16.038388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 551/1096] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:15 2022] GET /identity/v3/users/800797ea294e4b34b8a89ae049aea9f3 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:16.044621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92572645-1285-446a-bec8-1be0c5455664 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:16.060708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 546/1097] 10.222.0.46 () {56 vars in 1133 bytes} [Thu Jun 2 13:03:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:16.065218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d85ad-8ed7-4d03-8036-d578e7afc49a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:16.142657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92572645-1285-446a-bec8-1be0c5455664 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:16.167491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d85ad-8ed7-4d03-8036-d578e7afc49a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:16.169362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:16.176501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e6e95-6b6c-494b-ac69-60fee5a4ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:16.177152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6e95-6b6c-494b-ac69-60fee5a4ef2b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:16.177436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6e95-6b6c-494b-ac69-60fee5a4ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:16.177718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6e95-6b6c-494b-ac69-60fee5a4ef2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:16.202156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ef8ec-23be-4a3f-aafc-991708dc51e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:16.202811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ef8ec-23be-4a3f-aafc-991708dc51e4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:16.203094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ef8ec-23be-4a3f-aafc-991708dc51e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:16.203371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ef8ec-23be-4a3f-aafc-991708dc51e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:16.226896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:16.248336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e6e95-6b6c-494b-ac69-60fee5a4ef2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:16.249853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e6e95-6b6c-494b-ac69-60fee5a4ef2b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:16.287161 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ef8ec-23be-4a3f-aafc-991708dc51e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:16.288752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ef8ec-23be-4a3f-aafc-991708dc51e4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:16.351717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 552/1098] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:03:16.358179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e6e95-6b6c-494b-ac69-60fee5a4ef2b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:16.386316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 547/1099] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:03:16.392262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ef8ec-23be-4a3f-aafc-991708dc51e4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:16.394519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:16.438266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:16.457704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e6e95-6b6c-494b-ac69-60fee5a4ef2b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:16.491761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b18004-dd50-4b04-8705-62fef90ef363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:16.492654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18004-dd50-4b04-8705-62fef90ef363 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:16.492936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18004-dd50-4b04-8705-62fef90ef363 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:16.493203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18004-dd50-4b04-8705-62fef90ef363 None admin] PATH_INFO: `/v3/projects/767e552be00c469aa39627e04f587b89` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:16.494368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b18004-dd50-4b04-8705-62fef90ef363 None admin] RBAC: Authorizing `identity:get_project(project_id=767e552be00c469aa39627e04f587b89)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:16.495649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ef8ec-23be-4a3f-aafc-991708dc51e4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:16.495785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b18004-dd50-4b04-8705-62fef90ef363 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:16.497546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 553/1100] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:03:16 2022] GET /identity/v3/projects/767e552be00c469aa39627e04f587b89 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:16.503668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b18004-dd50-4b04-8705-62fef90ef363 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:16.530160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfb056-4b76-4cad-a55b-6037b5aedeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:16.530961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb056-4b76-4cad-a55b-6037b5aedeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:16.531244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb056-4b76-4cad-a55b-6037b5aedeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:16.531515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb056-4b76-4cad-a55b-6037b5aedeb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:16.542460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfb056-4b76-4cad-a55b-6037b5aedeb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:16.543935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfb056-4b76-4cad-a55b-6037b5aedeb5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-d9dfb056-4b76-4cad-a55b-6037b5aedeb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:03:16.561725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:16.562624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:16.563524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:03:16.563524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:03:16.563524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:03:16.563524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:16.563524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 548/1101] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:16.568565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfb056-4b76-4cad-a55b-6037b5aedeb5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:16.608880 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b18004-dd50-4b04-8705-62fef90ef363 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:16.622857 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:16.642809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0713dfc-609e-4c6c-bf0e-bf2faa86a53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:16.643471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713dfc-609e-4c6c-bf0e-bf2faa86a53c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:16.643754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713dfc-609e-4c6c-bf0e-bf2faa86a53c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:16.644059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713dfc-609e-4c6c-bf0e-bf2faa86a53c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:16.644897 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0713dfc-609e-4c6c-bf0e-bf2faa86a53c None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=767e552be00c469aa39627e04f587b89, user.id=800797ea294e4b34b8a89ae049aea9f3) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:16.645211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0713dfc-609e-4c6c-bf0e-bf2faa86a53c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:16.646690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0713dfc-609e-4c6c-bf0e-bf2faa86a53c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:16.653113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 554/1102] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:03:16 2022] GET /identity/v3/role_assignments?user.id=800797ea294e4b34b8a89ae049aea9f3&scope.project.id=767e552be00c469aa39627e04f587b89&role.id=31c5600d1f984a04827cf0052fc61678 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:16.668296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfb056-4b76-4cad-a55b-6037b5aedeb5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:16.705181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd578c6-014c-45a7-a23b-a2a514a2edab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:16.705861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd578c6-014c-45a7-a23b-a2a514a2edab None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:16.706148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd578c6-014c-45a7-a23b-a2a514a2edab None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:16.706426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd578c6-014c-45a7-a23b-a2a514a2edab None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:16.707154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd578c6-014c-45a7-a23b-a2a514a2edab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:16.707466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd578c6-014c-45a7-a23b-a2a514a2edab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:16.708913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd578c6-014c-45a7-a23b-a2a514a2edab None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:16.722708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 549/1103] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:03:16.728639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0713dfc-609e-4c6c-bf0e-bf2faa86a53c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:16.744644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:16.834881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0713dfc-609e-4c6c-bf0e-bf2faa86a53c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:16.871228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0e91-bc87-45e4-b617-b74e62cc079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:16.872100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0e91-bc87-45e4-b617-b74e62cc079c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:16.872386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0e91-bc87-45e4-b617-b74e62cc079c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:16.872662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0e91-bc87-45e4-b617-b74e62cc079c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:16.879543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc0e91-bc87-45e4-b617-b74e62cc079c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:16.881090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc0e91-bc87-45e4-b617-b74e62cc079c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-f2bc0e91-bc87-45e4-b617-b74e62cc079c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:03:16.895295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:16.896436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:16.897600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:03:16.897600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:03:16.897600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:03:16.897600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:03:16.897600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:03:16.897600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:03:16.897600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:03:16.897600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:16.897600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 555/1104] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:03:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:16.902824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd578c6-014c-45a7-a23b-a2a514a2edab None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:17.000127 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd578c6-014c-45a7-a23b-a2a514a2edab None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:17.013743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:17.033189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2f2c8-0ba4-49fc-a026-e4b0c3bbbbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:17.033850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2f2c8-0ba4-49fc-a026-e4b0c3bbbbad None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:17.034131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2f2c8-0ba4-49fc-a026-e4b0c3bbbbad None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:17.034404 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2f2c8-0ba4-49fc-a026-e4b0c3bbbbad None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:17.035184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2f2c8-0ba4-49fc-a026-e4b0c3bbbbad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:17.035486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2f2c8-0ba4-49fc-a026-e4b0c3bbbbad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:17.036933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2f2c8-0ba4-49fc-a026-e4b0c3bbbbad None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:17.048717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 550/1105] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:03:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:17.054689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0e91-bc87-45e4-b617-b74e62cc079c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:17.126438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:17.158150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0e91-bc87-45e4-b617-b74e62cc079c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:17.206664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eff5f6-8491-4833-8d0a-1a8a332cc54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:17.207328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eff5f6-8491-4833-8d0a-1a8a332cc54a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:17.207610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eff5f6-8491-4833-8d0a-1a8a332cc54a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:17.207898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eff5f6-8491-4833-8d0a-1a8a332cc54a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:17.208745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eff5f6-8491-4833-8d0a-1a8a332cc54a None admin] RBAC: Adding query filter params (role.id=545468338c4445a78e84a2ad0660817c, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=ae1c6084061f4434864e9f7bcc553733) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:17.209058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eff5f6-8491-4833-8d0a-1a8a332cc54a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:17.210492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eff5f6-8491-4833-8d0a-1a8a332cc54a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:17.216501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 556/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:03:17 2022] GET /identity/v3/role_assignments?user.id=ae1c6084061f4434864e9f7bcc553733&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=545468338c4445a78e84a2ad0660817c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:18.940187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e3b7-e363-42d0-a920-faa2dc56b2c8 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:18.940724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e3b7-e363-42d0-a920-faa2dc56b2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:18.940724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e3b7-e363-42d0-a920-faa2dc56b2c8 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:18.942126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 551/1107] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:18.947586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f7d0-2d02-4da5-bc13-92482147c2a8 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:18.948000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f7d0-2d02-4da5-bc13-92482147c2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:18.948171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f7d0-2d02-4da5-bc13-92482147c2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:18.964814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8143f7d0-2d02-4da5-bc13-92482147c2a8 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:18.966000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8143f7d0-2d02-4da5-bc13-92482147c2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:19.030315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 557/1108] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:19.055279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e3b7-e363-42d0-a920-faa2dc56b2c8 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:19.153928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e3b7-e363-42d0-a920-faa2dc56b2c8 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:19.186335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c602d-df57-457f-b9be-ffea4c426a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:19.187122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c602d-df57-457f-b9be-ffea4c426a5a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:19.187405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c602d-df57-457f-b9be-ffea4c426a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:19.187680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c602d-df57-457f-b9be-ffea4c426a5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:19.188862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c602d-df57-457f-b9be-ffea4c426a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:19.190344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c602d-df57-457f-b9be-ffea4c426a5a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:19.191925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 552/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:19.197828 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f7d0-2d02-4da5-bc13-92482147c2a8 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:19.260703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:19.301115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f7d0-2d02-4da5-bc13-92482147c2a8 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:19.333262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a04b0-4483-4c4e-8de8-8bc13a9cb84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:19.333982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a04b0-4483-4c4e-8de8-8bc13a9cb84f None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:19.334309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a04b0-4483-4c4e-8de8-8bc13a9cb84f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:19.334676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a04b0-4483-4c4e-8de8-8bc13a9cb84f None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:19.335432 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a04b0-4483-4c4e-8de8-8bc13a9cb84f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:19.337578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a04b0-4483-4c4e-8de8-8bc13a9cb84f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:19.430683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 558/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:03:19 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:21.693942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d1d78-2c0c-48fc-988e-963a16a22c34 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:21.694442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d1d78-2c0c-48fc-988e-963a16a22c34 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:21.694442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d1d78-2c0c-48fc-988e-963a16a22c34 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:21.695803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 553/1111] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:21.701697 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43be62-d11c-438b-8c49-85760d182352 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:21.702071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43be62-d11c-438b-8c49-85760d182352 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:21.702248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43be62-d11c-438b-8c49-85760d182352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:21.719624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-df43be62-d11c-438b-8c49-85760d182352 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:21.720836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-df43be62-d11c-438b-8c49-85760d182352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:21.783411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 559/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:21.806918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d1d78-2c0c-48fc-988e-963a16a22c34 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:21.850293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:21.905612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d1d78-2c0c-48fc-988e-963a16a22c34 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:21.937229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c97fa-332d-4caf-b29d-10f2bbf05f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:21.938062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c97fa-332d-4caf-b29d-10f2bbf05f75 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:21.938342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c97fa-332d-4caf-b29d-10f2bbf05f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:21.938614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c97fa-332d-4caf-b29d-10f2bbf05f75 None admin] PATH_INFO: `/v3/roles/c0027060d6364e5e9bd9c2cb5ad9788f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:21.940073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c97fa-332d-4caf-b29d-10f2bbf05f75 None admin] RBAC: Authorizing `identity:get_role(role_id=c0027060d6364e5e9bd9c2cb5ad9788f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:21.941430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c97fa-332d-4caf-b29d-10f2bbf05f75 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:21.942830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 554/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:21 2022] GET /identity/v3/roles/c0027060d6364e5e9bd9c2cb5ad9788f => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:21.949116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43be62-d11c-438b-8c49-85760d182352 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:22.005972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:22.051677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43be62-d11c-438b-8c49-85760d182352 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:22.085103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17424d4-217c-483f-b4f8-e16bcd0307a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:22.085969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17424d4-217c-483f-b4f8-e16bcd0307a9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:22.086251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17424d4-217c-483f-b4f8-e16bcd0307a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:22.086705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17424d4-217c-483f-b4f8-e16bcd0307a9 None admin] PATH_INFO: `/v3/users/db4de1e0fe56467ca447847e1e54a0c1` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:22.099595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17424d4-217c-483f-b4f8-e16bcd0307a9 None admin] RBAC: Authorizing `identity:get_user(user_id=db4de1e0fe56467ca447847e1e54a0c1)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:22.101060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17424d4-217c-483f-b4f8-e16bcd0307a9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:22.102744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 560/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:21 2022] GET /identity/v3/users/db4de1e0fe56467ca447847e1e54a0c1 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:22.108516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c97fa-332d-4caf-b29d-10f2bbf05f75 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:22.212998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c97fa-332d-4caf-b29d-10f2bbf05f75 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:22.223472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:22.246495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113364eb-e420-416b-840a-360a7e5f229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:22.247144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113364eb-e420-416b-840a-360a7e5f229b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:22.247424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113364eb-e420-416b-840a-360a7e5f229b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:22.247699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113364eb-e420-416b-840a-360a7e5f229b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:22.311856 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113364eb-e420-416b-840a-360a7e5f229b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:22.313530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113364eb-e420-416b-840a-360a7e5f229b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:22.406720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 555/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:03:22.412609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17424d4-217c-483f-b4f8-e16bcd0307a9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:22.509534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17424d4-217c-483f-b4f8-e16bcd0307a9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:22.519367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:22.541585 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710e74c-f826-4a79-b997-6758af5cf7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:22.542429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e74c-f826-4a79-b997-6758af5cf7db None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:22.542753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e74c-f826-4a79-b997-6758af5cf7db None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:22.543030 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e74c-f826-4a79-b997-6758af5cf7db None admin] PATH_INFO: `/v3/projects/767e552be00c469aa39627e04f587b89` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:22.544219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710e74c-f826-4a79-b997-6758af5cf7db None admin] RBAC: Authorizing `identity:get_project(project_id=767e552be00c469aa39627e04f587b89)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:22.545636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710e74c-f826-4a79-b997-6758af5cf7db None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:22.547402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 561/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:03:22 2022] GET /identity/v3/projects/767e552be00c469aa39627e04f587b89 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:22.553517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113364eb-e420-416b-840a-360a7e5f229b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:22.565361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:22.648242 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113364eb-e420-416b-840a-360a7e5f229b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:22.680969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6180e8a-0c9b-42b4-aa09-f9d888e9f6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:22.681601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180e8a-0c9b-42b4-aa09-f9d888e9f6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:22.681884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180e8a-0c9b-42b4-aa09-f9d888e9f6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:22.682157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180e8a-0c9b-42b4-aa09-f9d888e9f6b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:22.682970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6180e8a-0c9b-42b4-aa09-f9d888e9f6b1 None admin] RBAC: Adding query filter params (role.id=c0027060d6364e5e9bd9c2cb5ad9788f, scope.project.id=767e552be00c469aa39627e04f587b89, user.id=db4de1e0fe56467ca447847e1e54a0c1) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:22.683278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6180e8a-0c9b-42b4-aa09-f9d888e9f6b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:22.684703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6180e8a-0c9b-42b4-aa09-f9d888e9f6b1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:22.689934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 556/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:03:22 2022] GET /identity/v3/role_assignments?user.id=db4de1e0fe56467ca447847e1e54a0c1&scope.project.id=767e552be00c469aa39627e04f587b89&role.id=c0027060d6364e5e9bd9c2cb5ad9788f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:24.905413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6555d-ded9-40a6-be0d-516af82fca69 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:24.905957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6555d-ded9-40a6-be0d-516af82fca69 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:24.905957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6555d-ded9-40a6-be0d-516af82fca69 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:24.907334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 562/1118] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:24.912660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255deaee-c376-49e6-b723-3fe514db5cab None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:24.913086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255deaee-c376-49e6-b723-3fe514db5cab None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:24.913198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255deaee-c376-49e6-b723-3fe514db5cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:24.929438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-255deaee-c376-49e6-b723-3fe514db5cab None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:24.930645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-255deaee-c376-49e6-b723-3fe514db5cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:24.994647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 557/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:25.019341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6555d-ded9-40a6-be0d-516af82fca69 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:25.118617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6555d-ded9-40a6-be0d-516af82fca69 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:25.150708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc26cc-8bf7-41d5-a4b0-aaec9b4b9a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:25.151560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc26cc-8bf7-41d5-a4b0-aaec9b4b9a0c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:25.151842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc26cc-8bf7-41d5-a4b0-aaec9b4b9a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:25.152148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc26cc-8bf7-41d5-a4b0-aaec9b4b9a0c None admin] PATH_INFO: `/v3/roles/c0027060d6364e5e9bd9c2cb5ad9788f` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:25.153610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc26cc-8bf7-41d5-a4b0-aaec9b4b9a0c None admin] RBAC: Authorizing `identity:get_role(role_id=c0027060d6364e5e9bd9c2cb5ad9788f)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:25.154995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc26cc-8bf7-41d5-a4b0-aaec9b4b9a0c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:25.156461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 563/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:25 2022] GET /identity/v3/roles/c0027060d6364e5e9bd9c2cb5ad9788f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:25.162411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255deaee-c376-49e6-b723-3fe514db5cab None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:25.166063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:25.258830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255deaee-c376-49e6-b723-3fe514db5cab None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:25.291405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d87eb-0afe-4400-b9c4-cb8034b2ae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:25.292505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d87eb-0afe-4400-b9c4-cb8034b2ae11 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:25.292720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d87eb-0afe-4400-b9c4-cb8034b2ae11 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:25.292992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d87eb-0afe-4400-b9c4-cb8034b2ae11 None admin] PATH_INFO: `/v3/users/db4de1e0fe56467ca447847e1e54a0c1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:25.294151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d87eb-0afe-4400-b9c4-cb8034b2ae11 None admin] RBAC: Authorizing `identity:get_user(user_id=db4de1e0fe56467ca447847e1e54a0c1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:25.295582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d87eb-0afe-4400-b9c4-cb8034b2ae11 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:25.297268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 558/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:25 2022] GET /identity/v3/users/db4de1e0fe56467ca447847e1e54a0c1 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:25.303111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc26cc-8bf7-41d5-a4b0-aaec9b4b9a0c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:25.348992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:25.402569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc26cc-8bf7-41d5-a4b0-aaec9b4b9a0c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:25.435376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f7e02-f286-4833-9d4a-c887f306da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:25.436198 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7e02-f286-4833-9d4a-c887f306da63 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:25.436487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7e02-f286-4833-9d4a-c887f306da63 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:25.436764 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7e02-f286-4833-9d4a-c887f306da63 None admin] PATH_INFO: `/v3/projects/767e552be00c469aa39627e04f587b89` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:25.437931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f7e02-f286-4833-9d4a-c887f306da63 None admin] RBAC: Authorizing `identity:get_project(project_id=767e552be00c469aa39627e04f587b89)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:25.439363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f7e02-f286-4833-9d4a-c887f306da63 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:25.441101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 564/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:03:25 2022] GET /identity/v3/projects/767e552be00c469aa39627e04f587b89 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:25.447539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d87eb-0afe-4400-b9c4-cb8034b2ae11 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:25.522208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:25.551349 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d87eb-0afe-4400-b9c4-cb8034b2ae11 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:25.584521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65dd78-8a3d-4791-ba33-6c5c2a8b160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:25.585408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65dd78-8a3d-4791-ba33-6c5c2a8b160a None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:25.585695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65dd78-8a3d-4791-ba33-6c5c2a8b160a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:25.585971 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65dd78-8a3d-4791-ba33-6c5c2a8b160a None admin] PATH_INFO: `/v3/projects/767e552be00c469aa39627e04f587b89/users/db4de1e0fe56467ca447847e1e54a0c1/roles/c0027060d6364e5e9bd9c2cb5ad9788f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:25.588831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65dd78-8a3d-4791-ba33-6c5c2a8b160a None admin] RBAC: Authorizing `identity:create_grant(project_id=767e552be00c469aa39627e04f587b89, user_id=db4de1e0fe56467ca447847e1e54a0c1, role_id=c0027060d6364e5e9bd9c2cb5ad9788f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:25.590265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65dd78-8a3d-4791-ba33-6c5c2a8b160a None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:25.669150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 559/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:03:25 2022] PUT /identity/v3/projects/767e552be00c469aa39627e04f587b89/users/db4de1e0fe56467ca447847e1e54a0c1/roles/c0027060d6364e5e9bd9c2cb5ad9788f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:03:27.907179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f16c-c331-446f-b02d-c5fc57d5cad9 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:27.907724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f16c-c331-446f-b02d-c5fc57d5cad9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:27.907724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131f16c-c331-446f-b02d-c5fc57d5cad9 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:27.909192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 565/1124] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:27.914544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0560-94b0-407e-babc-c8bda01f8635 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:27.915074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0560-94b0-407e-babc-c8bda01f8635 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:27.915182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0560-94b0-407e-babc-c8bda01f8635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:27.931425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-ee0d0560-94b0-407e-babc-c8bda01f8635 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:27.932629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ee0d0560-94b0-407e-babc-c8bda01f8635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:27.996715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 560/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:28.020997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131f16c-c331-446f-b02d-c5fc57d5cad9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:28.122410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131f16c-c331-446f-b02d-c5fc57d5cad9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:28.136111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:28.154813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34395d95-4c6b-4bbe-964e-96d915133e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:28.155680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34395d95-4c6b-4bbe-964e-96d915133e5e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:28.155994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34395d95-4c6b-4bbe-964e-96d915133e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:28.156272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34395d95-4c6b-4bbe-964e-96d915133e5e None admin] PATH_INFO: `/v3/roles/c0027060d6364e5e9bd9c2cb5ad9788f` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:28.157822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34395d95-4c6b-4bbe-964e-96d915133e5e None admin] RBAC: Authorizing `identity:get_role(role_id=c0027060d6364e5e9bd9c2cb5ad9788f)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:28.159143 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34395d95-4c6b-4bbe-964e-96d915133e5e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:28.160553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 566/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:28 2022] GET /identity/v3/roles/c0027060d6364e5e9bd9c2cb5ad9788f => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:28.166746 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d0560-94b0-407e-babc-c8bda01f8635 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:28.226386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:28.264098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d0560-94b0-407e-babc-c8bda01f8635 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:28.297045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84465562-5920-41f5-9f49-d16f7a4e112d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:28.297910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465562-5920-41f5-9f49-d16f7a4e112d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:28.298199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465562-5920-41f5-9f49-d16f7a4e112d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:28.298472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465562-5920-41f5-9f49-d16f7a4e112d None admin] PATH_INFO: `/v3/users/db4de1e0fe56467ca447847e1e54a0c1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:28.299653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84465562-5920-41f5-9f49-d16f7a4e112d None admin] RBAC: Authorizing `identity:get_user(user_id=db4de1e0fe56467ca447847e1e54a0c1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:28.301123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84465562-5920-41f5-9f49-d16f7a4e112d None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:28.302762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 561/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:28 2022] GET /identity/v3/users/db4de1e0fe56467ca447847e1e54a0c1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:28.309258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34395d95-4c6b-4bbe-964e-96d915133e5e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:28.405962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34395d95-4c6b-4bbe-964e-96d915133e5e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:28.438121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dbe0a-ca4c-42dd-b76f-eed43df4ad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:28.438690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dbe0a-ca4c-42dd-b76f-eed43df4ad48 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:28.438972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dbe0a-ca4c-42dd-b76f-eed43df4ad48 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:28.439246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dbe0a-ca4c-42dd-b76f-eed43df4ad48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:28.486773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:28.504054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dbe0a-ca4c-42dd-b76f-eed43df4ad48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:28.505488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dbe0a-ca4c-42dd-b76f-eed43df4ad48 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:28.598785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 567/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:03:28.605372 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84465562-5920-41f5-9f49-d16f7a4e112d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:28.701738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84465562-5920-41f5-9f49-d16f7a4e112d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:28.729164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:28.734934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0814db-203d-4ccd-b804-42d8e991a2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:28.741148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0814db-203d-4ccd-b804-42d8e991a2ff None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:28.741148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0814db-203d-4ccd-b804-42d8e991a2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:28.741148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0814db-203d-4ccd-b804-42d8e991a2ff None admin] PATH_INFO: `/v3/projects/767e552be00c469aa39627e04f587b89` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:28.741148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0814db-203d-4ccd-b804-42d8e991a2ff None admin] RBAC: Authorizing `identity:get_project(project_id=767e552be00c469aa39627e04f587b89)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:28.741148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0814db-203d-4ccd-b804-42d8e991a2ff None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:28.741148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 562/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:03:28 2022] GET /identity/v3/projects/767e552be00c469aa39627e04f587b89 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:28.747807 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dbe0a-ca4c-42dd-b76f-eed43df4ad48 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:28.825883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:28.843328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dbe0a-ca4c-42dd-b76f-eed43df4ad48 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:28.877210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622c0e6-c68b-4082-97a5-e6131d3a4a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:28.877857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622c0e6-c68b-4082-97a5-e6131d3a4a9c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:28.878141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622c0e6-c68b-4082-97a5-e6131d3a4a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:28.878415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622c0e6-c68b-4082-97a5-e6131d3a4a9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:28.879235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622c0e6-c68b-4082-97a5-e6131d3a4a9c None admin] RBAC: Adding query filter params (role.id=c0027060d6364e5e9bd9c2cb5ad9788f, scope.project.id=767e552be00c469aa39627e04f587b89, user.id=db4de1e0fe56467ca447847e1e54a0c1) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:28.879545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622c0e6-c68b-4082-97a5-e6131d3a4a9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:28.881007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622c0e6-c68b-4082-97a5-e6131d3a4a9c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:28.886681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 568/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:03:28 2022] GET /identity/v3/role_assignments?user.id=db4de1e0fe56467ca447847e1e54a0c1&scope.project.id=767e552be00c469aa39627e04f587b89&role.id=c0027060d6364e5e9bd9c2cb5ad9788f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:31.134478 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d0b3-3957-4950-857b-febbf3930805 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:31.135070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d0b3-3957-4950-857b-febbf3930805 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:31.135070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d0b3-3957-4950-857b-febbf3930805 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:31.136435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 563/1131] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:31.141745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb3853-fbc1-4565-b690-2758136c6905 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:31.142231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb3853-fbc1-4565-b690-2758136c6905 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:31.142320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb3853-fbc1-4565-b690-2758136c6905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:31.159052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-aceb3853-fbc1-4565-b690-2758136c6905 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:31.160274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-aceb3853-fbc1-4565-b690-2758136c6905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:31.224164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 569/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:31.248234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422d0b3-3957-4950-857b-febbf3930805 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:31.347094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422d0b3-3957-4950-857b-febbf3930805 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:31.381413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb202f6-adab-4198-a7e7-ad302fd5fbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:31.382208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb202f6-adab-4198-a7e7-ad302fd5fbba None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:31.382485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb202f6-adab-4198-a7e7-ad302fd5fbba None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:31.382756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb202f6-adab-4198-a7e7-ad302fd5fbba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:31.384018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb202f6-adab-4198-a7e7-ad302fd5fbba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:31.385524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb202f6-adab-4198-a7e7-ad302fd5fbba None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:31.387170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 564/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:31.393031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb3853-fbc1-4565-b690-2758136c6905 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:31.477280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:31.506695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb3853-fbc1-4565-b690-2758136c6905 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:31.547861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd31f2-d9d5-4274-b91e-290864fcbb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:31.548558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd31f2-d9d5-4274-b91e-290864fcbb99 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:31.548842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd31f2-d9d5-4274-b91e-290864fcbb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:31.549118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd31f2-d9d5-4274-b91e-290864fcbb99 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:31.549823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd31f2-d9d5-4274-b91e-290864fcbb99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:31.551255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd31f2-d9d5-4274-b91e-290864fcbb99 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:31.636770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 570/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:03:31 2022] POST /identity/v3/projects => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:33.902493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d0fbd-0206-484c-99ca-a903c8fded20 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:33.903023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d0fbd-0206-484c-99ca-a903c8fded20 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:33.903023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d0fbd-0206-484c-99ca-a903c8fded20 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:33.904444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 565/1135] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:33.909675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31bb61-e011-49d8-9824-5a2b90f619e0 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:33.910096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31bb61-e011-49d8-9824-5a2b90f619e0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:33.910236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31bb61-e011-49d8-9824-5a2b90f619e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:33.926681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4c31bb61-e011-49d8-9824-5a2b90f619e0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:33.927912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4c31bb61-e011-49d8-9824-5a2b90f619e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:33.992364 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 571/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:34.017621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d0fbd-0206-484c-99ca-a903c8fded20 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:34.089459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:34.126972 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d0fbd-0206-484c-99ca-a903c8fded20 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:34.160462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1af6db-9997-46e9-b740-6f173559a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:34.161172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af6db-9997-46e9-b740-6f173559a120 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:34.161451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af6db-9997-46e9-b740-6f173559a120 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:34.161724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af6db-9997-46e9-b740-6f173559a120 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:34.162874 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1af6db-9997-46e9-b740-6f173559a120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:34.164357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1af6db-9997-46e9-b740-6f173559a120 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:34.166046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 566/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:03:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:34.172017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31bb61-e011-49d8-9824-5a2b90f619e0 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:34.229408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:34.270295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31bb61-e011-49d8-9824-5a2b90f619e0 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:34.303587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124e23c-f726-4b1a-8d2d-c4fe26f52a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:34.304290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e23c-f726-4b1a-8d2d-c4fe26f52a32 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:34.304577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e23c-f726-4b1a-8d2d-c4fe26f52a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:34.304853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e23c-f726-4b1a-8d2d-c4fe26f52a32 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:34.305572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124e23c-f726-4b1a-8d2d-c4fe26f52a32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:34.307556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124e23c-f726-4b1a-8d2d-c4fe26f52a32 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:34.395332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 572/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:03:34 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:36.673134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0af5e0-f032-4f35-bf3e-2c3ce1341bf4 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:36.673644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0af5e0-f032-4f35-bf3e-2c3ce1341bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:36.673644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0af5e0-f032-4f35-bf3e-2c3ce1341bf4 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:36.674957 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 567/1139] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:36.680301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b330a-5115-4445-bfed-415dfda250b9 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:36.680784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b330a-5115-4445-bfed-415dfda250b9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:36.680883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b330a-5115-4445-bfed-415dfda250b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:36.697957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-da7b330a-5115-4445-bfed-415dfda250b9 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:36.699158 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-da7b330a-5115-4445-bfed-415dfda250b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:36.764902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 573/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:36.789172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0af5e0-f032-4f35-bf3e-2c3ce1341bf4 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:36.895667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0af5e0-f032-4f35-bf3e-2c3ce1341bf4 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:36.928852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc5fb-843c-48ba-9328-bbfd4e03ce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:36.929571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc5fb-843c-48ba-9328-bbfd4e03ce5c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:36.929853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc5fb-843c-48ba-9328-bbfd4e03ce5c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:36.930124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc5fb-843c-48ba-9328-bbfd4e03ce5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:36.931971 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:36.940128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc5fb-843c-48ba-9328-bbfd4e03ce5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-c47cc5fb-843c-48ba-9328-bbfd4e03ce5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:03:36.948283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:36.956362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:36.957206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 568/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:36.957896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b330a-5115-4445-bfed-415dfda250b9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:37.000714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:37.054431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b330a-5115-4445-bfed-415dfda250b9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:37.089463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a24dc1-ac5b-4b8e-8800-f0c7fcb40346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:37.090137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a24dc1-ac5b-4b8e-8800-f0c7fcb40346 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:37.090420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a24dc1-ac5b-4b8e-8800-f0c7fcb40346 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:37.090690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a24dc1-ac5b-4b8e-8800-f0c7fcb40346 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:37.091436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a24dc1-ac5b-4b8e-8800-f0c7fcb40346 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:37.091740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a24dc1-ac5b-4b8e-8800-f0c7fcb40346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:37.093148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a24dc1-ac5b-4b8e-8800-f0c7fcb40346 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:37.101652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 574/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:37.107500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc5fb-843c-48ba-9328-bbfd4e03ce5c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:37.205668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc5fb-843c-48ba-9328-bbfd4e03ce5c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:37.238076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c872-4f0b-4506-9e3a-1881234ee915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:37.238942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c872-4f0b-4506-9e3a-1881234ee915 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:37.239225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c872-4f0b-4506-9e3a-1881234ee915 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:37.239496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c872-4f0b-4506-9e3a-1881234ee915 None admin] PATH_INFO: `/v3/users/1fc04712fd5647e9b1e46e49a02cff49` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:37.253076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c872-4f0b-4506-9e3a-1881234ee915 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc04712fd5647e9b1e46e49a02cff49)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:37.254532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c872-4f0b-4506-9e3a-1881234ee915 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:37.256289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 569/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:37 2022] GET /identity/v3/users/1fc04712fd5647e9b1e46e49a02cff49 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:37.263326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a24dc1-ac5b-4b8e-8800-f0c7fcb40346 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:37.358856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a24dc1-ac5b-4b8e-8800-f0c7fcb40346 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:37.366741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:37.394477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d5850-f7bc-434c-9faa-5da5d074889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:37.395138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5850-f7bc-434c-9faa-5da5d074889c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:37.395422 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5850-f7bc-434c-9faa-5da5d074889c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:37.396086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5850-f7bc-434c-9faa-5da5d074889c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:37.461664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d5850-f7bc-434c-9faa-5da5d074889c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:37.463074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d5850-f7bc-434c-9faa-5da5d074889c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:37.558435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 575/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:03:37.564318 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c872-4f0b-4506-9e3a-1881234ee915 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:37.615300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:37.660397 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c872-4f0b-4506-9e3a-1881234ee915 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:37.693757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525d07b-90ed-4a77-849f-97fc62ce11a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:37.694608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525d07b-90ed-4a77-849f-97fc62ce11a0 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:37.694888 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525d07b-90ed-4a77-849f-97fc62ce11a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:37.695159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525d07b-90ed-4a77-849f-97fc62ce11a0 None admin] PATH_INFO: `/v3/projects/1a99d2d931c24e5d9609496f86e5271a` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:37.696374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525d07b-90ed-4a77-849f-97fc62ce11a0 None admin] RBAC: Authorizing `identity:get_project(project_id=1a99d2d931c24e5d9609496f86e5271a)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:37.697803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525d07b-90ed-4a77-849f-97fc62ce11a0 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:37.699494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 570/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:03:37 2022] GET /identity/v3/projects/1a99d2d931c24e5d9609496f86e5271a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:37.705602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d5850-f7bc-434c-9faa-5da5d074889c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:37.713737 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:37.801313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d5850-f7bc-434c-9faa-5da5d074889c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:37.833970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1038f4-a57f-4a17-8856-740dfdc998d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:37.834619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1038f4-a57f-4a17-8856-740dfdc998d4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:37.834900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1038f4-a57f-4a17-8856-740dfdc998d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:37.835173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1038f4-a57f-4a17-8856-740dfdc998d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:37.836024 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1038f4-a57f-4a17-8856-740dfdc998d4 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=1a99d2d931c24e5d9609496f86e5271a, user.id=1fc04712fd5647e9b1e46e49a02cff49) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:37.836333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1038f4-a57f-4a17-8856-740dfdc998d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:37.838293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1038f4-a57f-4a17-8856-740dfdc998d4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:37.843576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 576/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:03:37 2022] GET /identity/v3/role_assignments?user.id=1fc04712fd5647e9b1e46e49a02cff49&scope.project.id=1a99d2d931c24e5d9609496f86e5271a&role.id=31c5600d1f984a04827cf0052fc61678 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:40.057364 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e83a9-a338-4e6c-9588-906bb331918d None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:40.057896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e83a9-a338-4e6c-9588-906bb331918d None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:40.057896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e83a9-a338-4e6c-9588-906bb331918d None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:40.059276 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 571/1147] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:40.064475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341443c6-b3ea-4137-a7dd-1458f69b9610 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:40.064908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341443c6-b3ea-4137-a7dd-1458f69b9610 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:40.065042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341443c6-b3ea-4137-a7dd-1458f69b9610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:40.081874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-341443c6-b3ea-4137-a7dd-1458f69b9610 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:40.083063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-341443c6-b3ea-4137-a7dd-1458f69b9610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:40.143431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:40.147913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 577/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:40.170732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e83a9-a338-4e6c-9588-906bb331918d None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:40.268860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e83a9-a338-4e6c-9588-906bb331918d None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:40.288073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:40.301345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570a04-6f48-4485-8ddb-b814952c2f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:40.302135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570a04-6f48-4485-8ddb-b814952c2f1a None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:40.302418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570a04-6f48-4485-8ddb-b814952c2f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:40.302691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570a04-6f48-4485-8ddb-b814952c2f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:40.313119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570a04-6f48-4485-8ddb-b814952c2f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-d6570a04-6f48-4485-8ddb-b814952c2f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:03:40.321673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:40.322742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:40.323663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 572/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:03:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:40.328954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341443c6-b3ea-4137-a7dd-1458f69b9610 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:40.428311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341443c6-b3ea-4137-a7dd-1458f69b9610 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:40.461976 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0b63-a388-4e41-8cf4-6e9a577f2a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:40.462661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0b63-a388-4e41-8cf4-6e9a577f2a3a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:40.462947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0b63-a388-4e41-8cf4-6e9a577f2a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:40.463227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0b63-a388-4e41-8cf4-6e9a577f2a3a None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:40.464018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c0b63-a388-4e41-8cf4-6e9a577f2a3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:40.464331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c0b63-a388-4e41-8cf4-6e9a577f2a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:40.465705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c0b63-a388-4e41-8cf4-6e9a577f2a3a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:40.473991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 578/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:40.480589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570a04-6f48-4485-8ddb-b814952c2f1a None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:40.581320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570a04-6f48-4485-8ddb-b814952c2f1a None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:40.613970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c64085-3619-4bc4-b682-37419c89b315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:40.614834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64085-3619-4bc4-b682-37419c89b315 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:40.615117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64085-3619-4bc4-b682-37419c89b315 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:40.615390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c64085-3619-4bc4-b682-37419c89b315 None admin] PATH_INFO: `/v3/users/1fc04712fd5647e9b1e46e49a02cff49` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:40.616607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c64085-3619-4bc4-b682-37419c89b315 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc04712fd5647e9b1e46e49a02cff49)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:40.618664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c64085-3619-4bc4-b682-37419c89b315 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:40.620323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 573/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:40 2022] GET /identity/v3/users/1fc04712fd5647e9b1e46e49a02cff49 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:40.626104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0b63-a388-4e41-8cf4-6e9a577f2a3a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:40.684621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:40.720383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0b63-a388-4e41-8cf4-6e9a577f2a3a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:40.754041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f307e76-f8e0-4352-8c2a-b8d2fa1727d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:40.754889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f307e76-f8e0-4352-8c2a-b8d2fa1727d2 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:40.755169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f307e76-f8e0-4352-8c2a-b8d2fa1727d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:40.755439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f307e76-f8e0-4352-8c2a-b8d2fa1727d2 None admin] PATH_INFO: `/v3/projects/1a99d2d931c24e5d9609496f86e5271a` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:40.756616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f307e76-f8e0-4352-8c2a-b8d2fa1727d2 None admin] RBAC: Authorizing `identity:get_project(project_id=1a99d2d931c24e5d9609496f86e5271a)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:40.758054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f307e76-f8e0-4352-8c2a-b8d2fa1727d2 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:40.759795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 579/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:03:40 2022] GET /identity/v3/projects/1a99d2d931c24e5d9609496f86e5271a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:40.765506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c64085-3619-4bc4-b682-37419c89b315 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:40.812992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:40.862142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c64085-3619-4bc4-b682-37419c89b315 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:40.893604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269e913-ab01-4823-8201-01ff10662204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:40.894485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269e913-ab01-4823-8201-01ff10662204 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:40.894772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269e913-ab01-4823-8201-01ff10662204 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:40.895052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269e913-ab01-4823-8201-01ff10662204 None admin] PATH_INFO: `/v3/projects/1a99d2d931c24e5d9609496f86e5271a/users/1fc04712fd5647e9b1e46e49a02cff49/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:40.897006 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269e913-ab01-4823-8201-01ff10662204 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a99d2d931c24e5d9609496f86e5271a, user_id=1fc04712fd5647e9b1e46e49a02cff49, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:40.898426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269e913-ab01-4823-8201-01ff10662204 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:40.971394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 574/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:03:40 2022] PUT /identity/v3/projects/1a99d2d931c24e5d9609496f86e5271a/users/1fc04712fd5647e9b1e46e49a02cff49/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:03:43.170676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2d14-5e28-4395-bddf-7fb734f974d6 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:43.171262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2d14-5e28-4395-bddf-7fb734f974d6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:43.171262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2d14-5e28-4395-bddf-7fb734f974d6 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:43.172633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 580/1154] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:43.177736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e241d40-e0a6-4282-8251-859f3107976b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:43.178158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e241d40-e0a6-4282-8251-859f3107976b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:43.178296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e241d40-e0a6-4282-8251-859f3107976b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:43.195474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0e241d40-e0a6-4282-8251-859f3107976b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:43.197307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0e241d40-e0a6-4282-8251-859f3107976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:43.261180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 575/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:43.285126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d2d14-5e28-4395-bddf-7fb734f974d6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:43.385576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d2d14-5e28-4395-bddf-7fb734f974d6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:43.413272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:43.419177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f078648-587b-4666-8e8b-15cd54b54980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:43.419993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f078648-587b-4666-8e8b-15cd54b54980 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:43.420277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f078648-587b-4666-8e8b-15cd54b54980 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:43.420547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f078648-587b-4666-8e8b-15cd54b54980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:43.437061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f078648-587b-4666-8e8b-15cd54b54980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-6f078648-587b-4666-8e8b-15cd54b54980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:03:43.438701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:43.439837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:43.440812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 581/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:43.445932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e241d40-e0a6-4282-8251-859f3107976b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:43.483955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:43.540856 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e241d40-e0a6-4282-8251-859f3107976b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:43.574580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de183ba-8411-4e3a-988e-8d67951adeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:43.575246 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de183ba-8411-4e3a-988e-8d67951adeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:43.575532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de183ba-8411-4e3a-988e-8d67951adeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:43.575809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de183ba-8411-4e3a-988e-8d67951adeb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:43.576591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de183ba-8411-4e3a-988e-8d67951adeb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:43.576897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de183ba-8411-4e3a-988e-8d67951adeb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:43.578260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de183ba-8411-4e3a-988e-8d67951adeb7 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:43.586173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 576/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:43.592217 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f078648-587b-4666-8e8b-15cd54b54980 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:43.690109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f078648-587b-4666-8e8b-15cd54b54980 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:43.722026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b418c32-2350-4b12-963e-4fd4af5207c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:43.722888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418c32-2350-4b12-963e-4fd4af5207c0 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:43.723170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418c32-2350-4b12-963e-4fd4af5207c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:43.723445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418c32-2350-4b12-963e-4fd4af5207c0 None admin] PATH_INFO: `/v3/users/1fc04712fd5647e9b1e46e49a02cff49` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:43.724632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b418c32-2350-4b12-963e-4fd4af5207c0 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc04712fd5647e9b1e46e49a02cff49)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:43.726055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b418c32-2350-4b12-963e-4fd4af5207c0 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:43.728194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 582/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:43 2022] GET /identity/v3/users/1fc04712fd5647e9b1e46e49a02cff49 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:43.733895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de183ba-8411-4e3a-988e-8d67951adeb7 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:43.826390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:43.829377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de183ba-8411-4e3a-988e-8d67951adeb7 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:43.863024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917c235-1f9c-4f22-a03c-687808b0e50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:43.863673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917c235-1f9c-4f22-a03c-687808b0e50c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:43.863992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917c235-1f9c-4f22-a03c-687808b0e50c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:43.864273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917c235-1f9c-4f22-a03c-687808b0e50c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:43.929451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917c235-1f9c-4f22-a03c-687808b0e50c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:43.930925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917c235-1f9c-4f22-a03c-687808b0e50c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:44.022568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:44.026597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 577/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:03:44.032832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b418c32-2350-4b12-963e-4fd4af5207c0 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:44.091075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:44.131899 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b418c32-2350-4b12-963e-4fd4af5207c0 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:44.165837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cf6b4-a52d-4880-bcf1-61c0ceb20a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:44.166706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cf6b4-a52d-4880-bcf1-61c0ceb20a88 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:44.167021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cf6b4-a52d-4880-bcf1-61c0ceb20a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:44.167302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cf6b4-a52d-4880-bcf1-61c0ceb20a88 None admin] PATH_INFO: `/v3/projects/1a99d2d931c24e5d9609496f86e5271a` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:44.168515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cf6b4-a52d-4880-bcf1-61c0ceb20a88 None admin] RBAC: Authorizing `identity:get_project(project_id=1a99d2d931c24e5d9609496f86e5271a)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:44.169949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870cf6b4-a52d-4880-bcf1-61c0ceb20a88 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:44.171659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 583/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:03:44 2022] GET /identity/v3/projects/1a99d2d931c24e5d9609496f86e5271a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:44.177835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917c235-1f9c-4f22-a03c-687808b0e50c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:44.278147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917c235-1f9c-4f22-a03c-687808b0e50c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:44.309846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec8bb0-d93e-4a69-b8c6-8fc8a91d7e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:44.310492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec8bb0-d93e-4a69-b8c6-8fc8a91d7e3e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:44.310773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec8bb0-d93e-4a69-b8c6-8fc8a91d7e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:44.311046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec8bb0-d93e-4a69-b8c6-8fc8a91d7e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:44.311853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec8bb0-d93e-4a69-b8c6-8fc8a91d7e3e None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=1a99d2d931c24e5d9609496f86e5271a, user.id=1fc04712fd5647e9b1e46e49a02cff49) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:44.312332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec8bb0-d93e-4a69-b8c6-8fc8a91d7e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:44.313615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec8bb0-d93e-4a69-b8c6-8fc8a91d7e3e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:44.319210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 578/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:03:44 2022] GET /identity/v3/role_assignments?user.id=1fc04712fd5647e9b1e46e49a02cff49&scope.project.id=1a99d2d931c24e5d9609496f86e5271a&role.id=31c5600d1f984a04827cf0052fc61678 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:46.568389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128de4a-c9cd-4676-b71c-033ba8f1fb2e None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:46.568931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128de4a-c9cd-4676-b71c-033ba8f1fb2e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:46.569036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128de4a-c9cd-4676-b71c-033ba8f1fb2e None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:46.570330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 584/1162] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:46.575956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a10d-8348-4a75-b525-d84107ac757b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:46.576431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a10d-8348-4a75-b525-d84107ac757b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:46.576526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a10d-8348-4a75-b525-d84107ac757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:46.592862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-5703a10d-8348-4a75-b525-d84107ac757b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:46.594043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5703a10d-8348-4a75-b525-d84107ac757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:46.650825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:46.658930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 579/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:46.682984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128de4a-c9cd-4676-b71c-033ba8f1fb2e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:46.786081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128de4a-c9cd-4676-b71c-033ba8f1fb2e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:46.812391 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:46.820637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a86ae-65a4-466e-863e-7e164e57a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:46.821291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a86ae-65a4-466e-863e-7e164e57a56c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:46.821573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a86ae-65a4-466e-863e-7e164e57a56c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:46.821871 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a86ae-65a4-466e-863e-7e164e57a56c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:46.888204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a86ae-65a4-466e-863e-7e164e57a56c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:46.889655 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a86ae-65a4-466e-863e-7e164e57a56c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:46.983312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 585/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:03:46.989621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703a10d-8348-4a75-b525-d84107ac757b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:47.082331 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703a10d-8348-4a75-b525-d84107ac757b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:47.115219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64ac7c-0ca2-4429-aba4-c7bb1cb6491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:47.116034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64ac7c-0ca2-4429-aba4-c7bb1cb6491e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:47.116317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64ac7c-0ca2-4429-aba4-c7bb1cb6491e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:47.116590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64ac7c-0ca2-4429-aba4-c7bb1cb6491e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:47.123045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64ac7c-0ca2-4429-aba4-c7bb1cb6491e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:47.124508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64ac7c-0ca2-4429-aba4-c7bb1cb6491e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-bc64ac7c-0ca2-4429-aba4-c7bb1cb6491e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:47.138212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:47.139438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:03:47.140387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 580/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Jun 2 13:03:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:47.145580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a86ae-65a4-466e-863e-7e164e57a56c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:47.172409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:47.243607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a86ae-65a4-466e-863e-7e164e57a56c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:47.276991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f6393-1695-4740-8884-870e1979462c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:47.277665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f6393-1695-4740-8884-870e1979462c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:47.277945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f6393-1695-4740-8884-870e1979462c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:47.278219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f6393-1695-4740-8884-870e1979462c None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:47.278940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f6393-1695-4740-8884-870e1979462c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:47.279245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f6393-1695-4740-8884-870e1979462c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:47.280645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f6393-1695-4740-8884-870e1979462c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:47.287834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 586/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Thu Jun 2 13:03:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:49.499629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585aba-e226-4e9d-b2fe-10977786cb8a None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:49.500290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585aba-e226-4e9d-b2fe-10977786cb8a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:49.500290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585aba-e226-4e9d-b2fe-10977786cb8a None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:49.501578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 581/1167] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:49.506861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2fe2-56d0-4139-b1fe-ac6ce5b2e206 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:49.507275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2fe2-56d0-4139-b1fe-ac6ce5b2e206 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:49.507430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2fe2-56d0-4139-b1fe-ac6ce5b2e206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:49.524855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-57ff2fe2-56d0-4139-b1fe-ac6ce5b2e206 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:49.526028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-57ff2fe2-56d0-4139-b1fe-ac6ce5b2e206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:49.589584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 587/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:49.612151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585aba-e226-4e9d-b2fe-10977786cb8a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:49.666316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:49.708153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585aba-e226-4e9d-b2fe-10977786cb8a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:49.740244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3de84-3f61-4db9-976a-7edf70381313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:49.740896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3de84-3f61-4db9-976a-7edf70381313 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:49.741176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3de84-3f61-4db9-976a-7edf70381313 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:49.741445 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3de84-3f61-4db9-976a-7edf70381313 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:49.742168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3de84-3f61-4db9-976a-7edf70381313 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:49.743550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3de84-3f61-4db9-976a-7edf70381313 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:49.909241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 582/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Thu Jun 2 13:03:49 2022] POST /identity/v3/domains => generated 267 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:52.174147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f97ec-ddf0-4842-88c5-6a49367e5593 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:52.174701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f97ec-ddf0-4842-88c5-6a49367e5593 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:52.174701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f97ec-ddf0-4842-88c5-6a49367e5593 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:52.176124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 588/1170] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:52.181814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adefad-3df9-412e-8649-caf987c6ec89 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:52.182247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adefad-3df9-412e-8649-caf987c6ec89 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:52.182379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adefad-3df9-412e-8649-caf987c6ec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:52.199395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-33adefad-3df9-412e-8649-caf987c6ec89 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:52.200607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-33adefad-3df9-412e-8649-caf987c6ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:52.264716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 583/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:03:52.288760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f97ec-ddf0-4842-88c5-6a49367e5593 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:52.310590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:52.387827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f97ec-ddf0-4842-88c5-6a49367e5593 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:52.421042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccefad3-7213-4a96-8db9-5042d5e5b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:52.421905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccefad3-7213-4a96-8db9-5042d5e5b50b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:52.422192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccefad3-7213-4a96-8db9-5042d5e5b50b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:52.422470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccefad3-7213-4a96-8db9-5042d5e5b50b None admin] PATH_INFO: `/v3/domains/26e6579f37044323bd4404c0d09837a9` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:52.433142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccefad3-7213-4a96-8db9-5042d5e5b50b None admin] RBAC: Authorizing `identity:get_domain(domain_id=26e6579f37044323bd4404c0d09837a9)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:52.434538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccefad3-7213-4a96-8db9-5042d5e5b50b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:52.436201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 589/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Thu Jun 2 13:03:52 2022] GET /identity/v3/domains/26e6579f37044323bd4404c0d09837a9 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:52.442142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adefad-3df9-412e-8649-caf987c6ec89 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:52.485688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:52.540627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adefad-3df9-412e-8649-caf987c6ec89 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:52.579389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abcaf4-a808-40ff-abc0-b8ac282508e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:52.580103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abcaf4-a808-40ff-abc0-b8ac282508e4 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:52.580393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abcaf4-a808-40ff-abc0-b8ac282508e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:52.580671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abcaf4-a808-40ff-abc0-b8ac282508e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:52.581403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abcaf4-a808-40ff-abc0-b8ac282508e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:52.582865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abcaf4-a808-40ff-abc0-b8ac282508e4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:52.732985 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 584/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:03:52 2022] POST /identity/v3/projects => generated 361 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:54.995557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b78f3-e2ea-4e2a-9858-2f8751ed1afa None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:54.996151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b78f3-e2ea-4e2a-9858-2f8751ed1afa None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:54.996151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b78f3-e2ea-4e2a-9858-2f8751ed1afa None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:54.997503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 590/1174] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:55.002757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512617-bd99-4a18-9c93-d755f2dc9990 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:55.003144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512617-bd99-4a18-9c93-d755f2dc9990 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:55.003329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512617-bd99-4a18-9c93-d755f2dc9990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:55.019782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-e7512617-bd99-4a18-9c93-d755f2dc9990 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:55.021007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e7512617-bd99-4a18-9c93-d755f2dc9990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:55.084816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 585/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:55.110492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b78f3-e2ea-4e2a-9858-2f8751ed1afa None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:55.189447 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:55.208183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b78f3-e2ea-4e2a-9858-2f8751ed1afa None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:55.243271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4f729-c53a-4a1f-a96e-41619b2210d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:55.244160 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f729-c53a-4a1f-a96e-41619b2210d6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:55.244441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f729-c53a-4a1f-a96e-41619b2210d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:55.244715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f729-c53a-4a1f-a96e-41619b2210d6 None admin] PATH_INFO: `/v3/domains/26e6579f37044323bd4404c0d09837a9` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:55.245922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4f729-c53a-4a1f-a96e-41619b2210d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=26e6579f37044323bd4404c0d09837a9)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:55.247304 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4f729-c53a-4a1f-a96e-41619b2210d6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:55.248944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 591/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Thu Jun 2 13:03:55 2022] GET /identity/v3/domains/26e6579f37044323bd4404c0d09837a9 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:55.254672 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7512617-bd99-4a18-9c93-d755f2dc9990 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:55.280582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:55.350608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7512617-bd99-4a18-9c93-d755f2dc9990 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:55.384151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e1e60-0383-4323-b2a0-a4e9e391edfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:55.384821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e1e60-0383-4323-b2a0-a4e9e391edfa None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:55.385100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e1e60-0383-4323-b2a0-a4e9e391edfa None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:55.385371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e1e60-0383-4323-b2a0-a4e9e391edfa None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:55.386083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e1e60-0383-4323-b2a0-a4e9e391edfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:55.387494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e1e60-0383-4323-b2a0-a4e9e391edfa None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:55.456330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 586/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:03:55 2022] POST /identity/v3/users => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:03:57.743939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20cd97-0634-4c3e-ac28-9259ac393907 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:57.744453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20cd97-0634-4c3e-ac28-9259ac393907 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:57.744453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20cd97-0634-4c3e-ac28-9259ac393907 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:57.745797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 592/1178] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:03:57.750962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1c28-bb80-4bde-8e56-54f1ad0124c0 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:57.751342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1c28-bb80-4bde-8e56-54f1ad0124c0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:57.751521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1c28-bb80-4bde-8e56-54f1ad0124c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:57.767828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-802a1c28-bb80-4bde-8e56-54f1ad0124c0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:03:57.769049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-802a1c28-bb80-4bde-8e56-54f1ad0124c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:03:57.832648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 587/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:03:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:03:57.856773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20cd97-0634-4c3e-ac28-9259ac393907 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:57.955333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20cd97-0634-4c3e-ac28-9259ac393907 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:57.989211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e155a-ba9d-45c0-b65d-9f9373272815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:57.989996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e155a-ba9d-45c0-b65d-9f9373272815 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:57.990276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e155a-ba9d-45c0-b65d-9f9373272815 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:57.990546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e155a-ba9d-45c0-b65d-9f9373272815 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:58.002538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e155a-ba9d-45c0-b65d-9f9373272815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-fd1e155a-ba9d-45c0-b65d-9f9373272815 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:03:58.010271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:03:58.011402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:03:58.012358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 593/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:03:58.017891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a1c28-bb80-4bde-8e56-54f1ad0124c0 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:58.032454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:58.120030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a1c28-bb80-4bde-8e56-54f1ad0124c0 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:58.152760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c008fb9-3b7f-4aa2-8dc7-4453e0026c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:58.153423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c008fb9-3b7f-4aa2-8dc7-4453e0026c6b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:58.153711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c008fb9-3b7f-4aa2-8dc7-4453e0026c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:58.153986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c008fb9-3b7f-4aa2-8dc7-4453e0026c6b None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:58.154724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c008fb9-3b7f-4aa2-8dc7-4453e0026c6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:58.155029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c008fb9-3b7f-4aa2-8dc7-4453e0026c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:58.156421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c008fb9-3b7f-4aa2-8dc7-4453e0026c6b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:58.164701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 588/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:58.170521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e155a-ba9d-45c0-b65d-9f9373272815 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:58.181695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:58.267068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e155a-ba9d-45c0-b65d-9f9373272815 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:58.299969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a5612-c888-4cb3-bf6c-84a31257cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:58.300831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5612-c888-4cb3-bf6c-84a31257cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:58.301113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5612-c888-4cb3-bf6c-84a31257cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:58.301386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5612-c888-4cb3-bf6c-84a31257cbc9 None admin] PATH_INFO: `/v3/users/52f968a4e7494cc1ba7ad0d31cc748a5` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:58.314026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a5612-c888-4cb3-bf6c-84a31257cbc9 None admin] RBAC: Authorizing `identity:get_user(user_id=52f968a4e7494cc1ba7ad0d31cc748a5)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:58.315478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a5612-c888-4cb3-bf6c-84a31257cbc9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:58.317137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 594/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:03:58 2022] GET /identity/v3/users/52f968a4e7494cc1ba7ad0d31cc748a5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:58.322861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c008fb9-3b7f-4aa2-8dc7-4453e0026c6b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:58.394904 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:58.419391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c008fb9-3b7f-4aa2-8dc7-4453e0026c6b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:58.451289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d82b4-5236-4c20-9009-6c6141944427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:58.451970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d82b4-5236-4c20-9009-6c6141944427 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:58.452256 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d82b4-5236-4c20-9009-6c6141944427 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:58.452536 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d82b4-5236-4c20-9009-6c6141944427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:58.516064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d82b4-5236-4c20-9009-6c6141944427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:58.517555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d82b4-5236-4c20-9009-6c6141944427 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:58.586865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:58.610278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 589/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:03:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:03:58.616541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a5612-c888-4cb3-bf6c-84a31257cbc9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:58.679044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:03:58.712362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a5612-c888-4cb3-bf6c-84a31257cbc9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:58.745964 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24720d4f-5407-41c0-a9b4-9f6b33d043af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:58.746819 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24720d4f-5407-41c0-a9b4-9f6b33d043af None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:58.747104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24720d4f-5407-41c0-a9b4-9f6b33d043af None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:58.747379 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24720d4f-5407-41c0-a9b4-9f6b33d043af None admin] PATH_INFO: `/v3/projects/b81917455c6f43f68047333efa8f93a2` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:58.748573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24720d4f-5407-41c0-a9b4-9f6b33d043af None admin] RBAC: Authorizing `identity:get_project(project_id=b81917455c6f43f68047333efa8f93a2)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:58.750005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24720d4f-5407-41c0-a9b4-9f6b33d043af None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:58.751691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 595/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:03:58 2022] GET /identity/v3/projects/b81917455c6f43f68047333efa8f93a2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:03:58.758272 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d82b4-5236-4c20-9009-6c6141944427 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:03:58.850933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d82b4-5236-4c20-9009-6c6141944427 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:03:58.883161 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df56be-6013-4654-b1e3-3971988e560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:03:58.883799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df56be-6013-4654-b1e3-3971988e560f None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:03:58.884112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df56be-6013-4654-b1e3-3971988e560f None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:03:58.884389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df56be-6013-4654-b1e3-3971988e560f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:03:58.885209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df56be-6013-4654-b1e3-3971988e560f None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=b81917455c6f43f68047333efa8f93a2, user.id=52f968a4e7494cc1ba7ad0d31cc748a5) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:03:58.885521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df56be-6013-4654-b1e3-3971988e560f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:03:58.886946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df56be-6013-4654-b1e3-3971988e560f None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:03:58.892212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 590/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:03:58 2022] GET /identity/v3/role_assignments?user.id=52f968a4e7494cc1ba7ad0d31cc748a5&scope.project.id=b81917455c6f43f68047333efa8f93a2&role.id=31c5600d1f984a04827cf0052fc61678 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:04:01.076762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe4608-167e-4192-985a-6d623322b8fe None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:01.077301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe4608-167e-4192-985a-6d623322b8fe None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:01.077301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe4608-167e-4192-985a-6d623322b8fe None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:01.078664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 596/1186] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:04:01.083838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d617b-ac5b-4c5f-a9cb-3632322912af None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:01.084234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d617b-ac5b-4c5f-a9cb-3632322912af None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:01.084440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d617b-ac5b-4c5f-a9cb-3632322912af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:01.100848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-5f3d617b-ac5b-4c5f-a9cb-3632322912af None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:04:01.102077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5f3d617b-ac5b-4c5f-a9cb-3632322912af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:04:01.130993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:04:01.166636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 591/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:04:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:04:01.189657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe4608-167e-4192-985a-6d623322b8fe None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:01.287645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe4608-167e-4192-985a-6d623322b8fe None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:01.321586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735f9c8-7286-4377-858d-58dff7064a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:01.322375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735f9c8-7286-4377-858d-58dff7064a1b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:01.322657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735f9c8-7286-4377-858d-58dff7064a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:01.322927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735f9c8-7286-4377-858d-58dff7064a1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:01.324857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:04:01.334606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735f9c8-7286-4377-858d-58dff7064a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-9735f9c8-7286-4377-858d-58dff7064a1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:04:01.341149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:04:01.342322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:04:01.348416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 597/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:04:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:04:01.349289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d617b-ac5b-4c5f-a9cb-3632322912af None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:01.447153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d617b-ac5b-4c5f-a9cb-3632322912af None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:01.480375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f69b6-0c6c-438c-a6d8-0be809c1df72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:01.481049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f69b6-0c6c-438c-a6d8-0be809c1df72 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:01.481336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f69b6-0c6c-438c-a6d8-0be809c1df72 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:01.481613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f69b6-0c6c-438c-a6d8-0be809c1df72 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:01.482360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f69b6-0c6c-438c-a6d8-0be809c1df72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:04:01.482668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f69b6-0c6c-438c-a6d8-0be809c1df72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:04:01.484056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f69b6-0c6c-438c-a6d8-0be809c1df72 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:04:01.492925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 592/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:04:01.500571 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735f9c8-7286-4377-858d-58dff7064a1b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:01.596518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735f9c8-7286-4377-858d-58dff7064a1b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:01.629626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1de50-5d4f-4e2c-8a42-59572653921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:01.630496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1de50-5d4f-4e2c-8a42-59572653921c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:01.630780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1de50-5d4f-4e2c-8a42-59572653921c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:01.631056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1de50-5d4f-4e2c-8a42-59572653921c None admin] PATH_INFO: `/v3/users/52f968a4e7494cc1ba7ad0d31cc748a5` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:01.632262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1de50-5d4f-4e2c-8a42-59572653921c None admin] RBAC: Authorizing `identity:get_user(user_id=52f968a4e7494cc1ba7ad0d31cc748a5)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:04:01.633690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1de50-5d4f-4e2c-8a42-59572653921c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:04:01.635317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 598/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:04:01 2022] GET /identity/v3/users/52f968a4e7494cc1ba7ad0d31cc748a5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:04:01.641077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f69b6-0c6c-438c-a6d8-0be809c1df72 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:01.670772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:04:01.737493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f69b6-0c6c-438c-a6d8-0be809c1df72 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:01.769285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21df123-8f31-448b-9074-6ed0c0cea432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:01.770157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21df123-8f31-448b-9074-6ed0c0cea432 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:01.770435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21df123-8f31-448b-9074-6ed0c0cea432 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:01.770709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21df123-8f31-448b-9074-6ed0c0cea432 None admin] PATH_INFO: `/v3/projects/b81917455c6f43f68047333efa8f93a2` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:01.771850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21df123-8f31-448b-9074-6ed0c0cea432 None admin] RBAC: Authorizing `identity:get_project(project_id=b81917455c6f43f68047333efa8f93a2)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:04:01.773343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21df123-8f31-448b-9074-6ed0c0cea432 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:04:01.775009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 593/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:04:01 2022] GET /identity/v3/projects/b81917455c6f43f68047333efa8f93a2 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:04:01.780940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1de50-5d4f-4e2c-8a42-59572653921c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:01.840985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:04:01.878944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1de50-5d4f-4e2c-8a42-59572653921c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:01.911097 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10467819-e820-4824-afab-a8d95c889282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:01.912003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10467819-e820-4824-afab-a8d95c889282 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:01.912286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10467819-e820-4824-afab-a8d95c889282 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:01.912564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10467819-e820-4824-afab-a8d95c889282 None admin] PATH_INFO: `/v3/projects/b81917455c6f43f68047333efa8f93a2/users/52f968a4e7494cc1ba7ad0d31cc748a5/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:01.915086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10467819-e820-4824-afab-a8d95c889282 None admin] RBAC: Authorizing `identity:create_grant(project_id=b81917455c6f43f68047333efa8f93a2, user_id=52f968a4e7494cc1ba7ad0d31cc748a5, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:04:01.916559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10467819-e820-4824-afab-a8d95c889282 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:04:01.998841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 599/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:04:01 2022] PUT /identity/v3/projects/b81917455c6f43f68047333efa8f93a2/users/52f968a4e7494cc1ba7ad0d31cc748a5/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:04:04.249936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2cb7-790e-4e66-86f2-bb90d8cdff7f None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:04.250461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2cb7-790e-4e66-86f2-bb90d8cdff7f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:04.250552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2cb7-790e-4e66-86f2-bb90d8cdff7f None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:04.251886 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 594/1193] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:04:04.257943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d353797-670c-473e-865a-86018c74c084 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:04.258339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d353797-670c-473e-865a-86018c74c084 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:04.258511 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d353797-670c-473e-865a-86018c74c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:04.275520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3d353797-670c-473e-865a-86018c74c084 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:04:04.276744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3d353797-670c-473e-865a-86018c74c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:04:04.340177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 600/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:04:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:04:04.364335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2cb7-790e-4e66-86f2-bb90d8cdff7f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:04.460656 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:04:04.465185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2cb7-790e-4e66-86f2-bb90d8cdff7f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:04.498423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ea34-e312-4295-a767-c56ed878244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:04.499195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ea34-e312-4295-a767-c56ed878244d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:04.499471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ea34-e312-4295-a767-c56ed878244d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:04.499741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ea34-e312-4295-a767-c56ed878244d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:04.510073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979ea34-e312-4295-a767-c56ed878244d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-1979ea34-e312-4295-a767-c56ed878244d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:04:04.517674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:04:04.518749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:04:04.519639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 595/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:04:04.524824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d353797-670c-473e-865a-86018c74c084 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:04.575041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:04:04.620915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d353797-670c-473e-865a-86018c74c084 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:04.653933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c846b-ecc7-4d4b-adb0-4369ed84d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:04.654604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c846b-ecc7-4d4b-adb0-4369ed84d0bc None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:04.654889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c846b-ecc7-4d4b-adb0-4369ed84d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:04.655168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c846b-ecc7-4d4b-adb0-4369ed84d0bc None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:04.655947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c846b-ecc7-4d4b-adb0-4369ed84d0bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:04:04.656257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c846b-ecc7-4d4b-adb0-4369ed84d0bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:04:04.657644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c846b-ecc7-4d4b-adb0-4369ed84d0bc None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:04:04.666030 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 601/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:04:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:04:04.671747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ea34-e312-4295-a767-c56ed878244d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:04.768379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ea34-e312-4295-a767-c56ed878244d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:04.800318 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4aecc-dec2-4db4-8f5c-2604946c142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:04.801184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4aecc-dec2-4db4-8f5c-2604946c142b None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:04.801464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4aecc-dec2-4db4-8f5c-2604946c142b None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:04.801735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4aecc-dec2-4db4-8f5c-2604946c142b None admin] PATH_INFO: `/v3/users/52f968a4e7494cc1ba7ad0d31cc748a5` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:04.802901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4aecc-dec2-4db4-8f5c-2604946c142b None admin] RBAC: Authorizing `identity:get_user(user_id=52f968a4e7494cc1ba7ad0d31cc748a5)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:04:04.805015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4aecc-dec2-4db4-8f5c-2604946c142b None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:04:04.806627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 596/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Thu Jun 2 13:04:04 2022] GET /identity/v3/users/52f968a4e7494cc1ba7ad0d31cc748a5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:04:04.812540 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c846b-ecc7-4d4b-adb0-4369ed84d0bc None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:04.912174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c846b-ecc7-4d4b-adb0-4369ed84d0bc None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:04.925625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:04:04.944491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897db00-66d4-434c-8b21-f0c964040526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:04.945160 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897db00-66d4-434c-8b21-f0c964040526 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:04.945446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897db00-66d4-434c-8b21-f0c964040526 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:04.945725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897db00-66d4-434c-8b21-f0c964040526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:05.012010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897db00-66d4-434c-8b21-f0c964040526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:04:05.013533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897db00-66d4-434c-8b21-f0c964040526 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:04:05.109775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 602/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:04:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:04:05.116685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4aecc-dec2-4db4-8f5c-2604946c142b None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:05.144031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:04:05.221644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4aecc-dec2-4db4-8f5c-2604946c142b None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:05.253997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6adb1-63cb-450f-9a3e-4a5ae937522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:05.254856 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6adb1-63cb-450f-9a3e-4a5ae937522e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:05.255137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6adb1-63cb-450f-9a3e-4a5ae937522e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:05.255407 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6adb1-63cb-450f-9a3e-4a5ae937522e None admin] PATH_INFO: `/v3/projects/b81917455c6f43f68047333efa8f93a2` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:05.256611 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6adb1-63cb-450f-9a3e-4a5ae937522e None admin] RBAC: Authorizing `identity:get_project(project_id=b81917455c6f43f68047333efa8f93a2)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:04:05.258544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6adb1-63cb-450f-9a3e-4a5ae937522e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:04:05.260271 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 597/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Thu Jun 2 13:04:05 2022] GET /identity/v3/projects/b81917455c6f43f68047333efa8f93a2 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:04:05.266421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897db00-66d4-434c-8b21-f0c964040526 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:04:05.281697 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:04:05.364657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897db00-66d4-434c-8b21-f0c964040526 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:04:05.398954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2954e67-6199-4f39-9432-5477a7abbfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:04:05.399612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2954e67-6199-4f39-9432-5477a7abbfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:04:05.399910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2954e67-6199-4f39-9432-5477a7abbfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:04:05.400189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2954e67-6199-4f39-9432-5477a7abbfc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:04:05.401017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2954e67-6199-4f39-9432-5477a7abbfc7 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=b81917455c6f43f68047333efa8f93a2, user.id=52f968a4e7494cc1ba7ad0d31cc748a5) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:04:05.401328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2954e67-6199-4f39-9432-5477a7abbfc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:04:05.402760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2954e67-6199-4f39-9432-5477a7abbfc7 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:04:05.408633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 603/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:04:05 2022] GET /identity/v3/role_assignments?user.id=52f968a4e7494cc1ba7ad0d31cc748a5&scope.project.id=b81917455c6f43f68047333efa8f93a2&role.id=31c5600d1f984a04827cf0052fc61678 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:04:15.249873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=53 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:04:15.405957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=61 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:21.460783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da2054-6de6-4408-b645-f67ce57c02c1 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:21.461459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da2054-6de6-4408-b645-f67ce57c02c1 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:21.461459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da2054-6de6-4408-b645-f67ce57c02c1 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:21.462813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 598/1201] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:05:21.468025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459253ab-7cbc-41ca-b9c1-4534bd97bea5 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:21.468446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459253ab-7cbc-41ca-b9c1-4534bd97bea5 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:21.468589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459253ab-7cbc-41ca-b9c1-4534bd97bea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:21.485488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-459253ab-7cbc-41ca-b9c1-4534bd97bea5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:21.486719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-459253ab-7cbc-41ca-b9c1-4534bd97bea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:21.555194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 604/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:05:21.584304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da2054-6de6-4408-b645-f67ce57c02c1 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:21.687745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da2054-6de6-4408-b645-f67ce57c02c1 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:21.720323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458eaae-00b2-473a-b8f9-947fdc4bffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:21.721161 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458eaae-00b2-473a-b8f9-947fdc4bffe8 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:21.721446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458eaae-00b2-473a-b8f9-947fdc4bffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:21.721724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458eaae-00b2-473a-b8f9-947fdc4bffe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:21.737504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458eaae-00b2-473a-b8f9-947fdc4bffe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:21.742636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458eaae-00b2-473a-b8f9-947fdc4bffe8 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-7458eaae-00b2-473a-b8f9-947fdc4bffe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:21.760767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:21.761745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:21.762806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:21.762806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:21.762806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:21.762806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:21.762806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 599/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:21.768031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459253ab-7cbc-41ca-b9c1-4534bd97bea5 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:21.867733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459253ab-7cbc-41ca-b9c1-4534bd97bea5 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:21.895957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:21.902018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b60c93-2332-4d29-a20d-52d2aa630aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:21.902683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60c93-2332-4d29-a20d-52d2aa630aab None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:21.902965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60c93-2332-4d29-a20d-52d2aa630aab None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:21.903241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60c93-2332-4d29-a20d-52d2aa630aab None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:21.904059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b60c93-2332-4d29-a20d-52d2aa630aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:21.904365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b60c93-2332-4d29-a20d-52d2aa630aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:21.905743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b60c93-2332-4d29-a20d-52d2aa630aab None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:21.918210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 605/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:21.923831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458eaae-00b2-473a-b8f9-947fdc4bffe8 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:21.977048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:22.021636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458eaae-00b2-473a-b8f9-947fdc4bffe8 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:22.053769 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92194a-6e4e-4bad-b0a6-7c41b819f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:22.054423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92194a-6e4e-4bad-b0a6-7c41b819f132 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:22.054710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92194a-6e4e-4bad-b0a6-7c41b819f132 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:22.054987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92194a-6e4e-4bad-b0a6-7c41b819f132 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:22.055675 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92194a-6e4e-4bad-b0a6-7c41b819f132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:22.057136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92194a-6e4e-4bad-b0a6-7c41b819f132 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:22.133767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 600/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Thu Jun 2 13:05:21 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:05:24.371712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c131e-a571-4a59-96c6-bbec35ade54c None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:24.372292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c131e-a571-4a59-96c6-bbec35ade54c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:24.372387 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c131e-a571-4a59-96c6-bbec35ade54c None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:24.373742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 606/1206] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:05:24.379012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a761-f98c-47e0-8bae-ae248d00e4a6 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:24.379470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a761-f98c-47e0-8bae-ae248d00e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:24.379572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a761-f98c-47e0-8bae-ae248d00e4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:24.400452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d214a761-f98c-47e0-8bae-ae248d00e4a6 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:24.400452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d214a761-f98c-47e0-8bae-ae248d00e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:24.462864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 601/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:05:24.487143 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c131e-a571-4a59-96c6-bbec35ade54c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:24.586338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c131e-a571-4a59-96c6-bbec35ade54c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:24.619418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faa88a-585e-4516-9c32-51d1409d3901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:24.620247 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faa88a-585e-4516-9c32-51d1409d3901 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:24.620529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faa88a-585e-4516-9c32-51d1409d3901 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:24.620805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faa88a-585e-4516-9c32-51d1409d3901 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:24.633181 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faa88a-585e-4516-9c32-51d1409d3901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-a7faa88a-585e-4516-9c32-51d1409d3901 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:05:24.640800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:24.644459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:24.646008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 607/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:05:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:24.648542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214a761-f98c-47e0-8bae-ae248d00e4a6 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:24.688402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:24.747094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214a761-f98c-47e0-8bae-ae248d00e4a6 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:24.779962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c38c6-97a0-4b1b-b588-452c82c570c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:24.780623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c38c6-97a0-4b1b-b588-452c82c570c8 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:24.780905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c38c6-97a0-4b1b-b588-452c82c570c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:24.781179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c38c6-97a0-4b1b-b588-452c82c570c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:24.781916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c38c6-97a0-4b1b-b588-452c82c570c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:24.782222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c38c6-97a0-4b1b-b588-452c82c570c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:24.783640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c38c6-97a0-4b1b-b588-452c82c570c8 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:24.791211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 602/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:05:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:24.797236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faa88a-585e-4516-9c32-51d1409d3901 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:24.846880 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:24.893876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faa88a-585e-4516-9c32-51d1409d3901 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:24.926677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecfc4c-26ec-4964-8127-dfb7b94e79e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:24.927461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecfc4c-26ec-4964-8127-dfb7b94e79e4 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:24.927744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecfc4c-26ec-4964-8127-dfb7b94e79e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:24.928048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecfc4c-26ec-4964-8127-dfb7b94e79e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:24.937856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecfc4c-26ec-4964-8127-dfb7b94e79e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:24.939308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecfc4c-26ec-4964-8127-dfb7b94e79e4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-15ecfc4c-26ec-4964-8127-dfb7b94e79e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:24.956723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:24.957810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:24.967348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:24.967348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:24.967348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:24.967348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:24.967348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 608/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:24.967691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c38c6-97a0-4b1b-b588-452c82c570c8 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:25.060460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:25.063334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c38c6-97a0-4b1b-b588-452c82c570c8 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:25.095510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae79cac-2b44-4dfe-8676-b6ab6167de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:25.096211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae79cac-2b44-4dfe-8676-b6ab6167de90 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:25.096500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae79cac-2b44-4dfe-8676-b6ab6167de90 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:25.096780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae79cac-2b44-4dfe-8676-b6ab6167de90 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:25.097505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae79cac-2b44-4dfe-8676-b6ab6167de90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:25.097815 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae79cac-2b44-4dfe-8676-b6ab6167de90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:25.099236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae79cac-2b44-4dfe-8676-b6ab6167de90 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:25.111312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 603/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:25.117688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecfc4c-26ec-4964-8127-dfb7b94e79e4 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:25.215271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecfc4c-26ec-4964-8127-dfb7b94e79e4 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:25.216769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:25.248624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d6a76-f07f-4f9a-8abc-5bfb4c54978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:25.249419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d6a76-f07f-4f9a-8abc-5bfb4c54978f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:25.249706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d6a76-f07f-4f9a-8abc-5bfb4c54978f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:25.249990 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d6a76-f07f-4f9a-8abc-5bfb4c54978f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:25.257309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d6a76-f07f-4f9a-8abc-5bfb4c54978f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:25.259459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d6a76-f07f-4f9a-8abc-5bfb4c54978f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-fc2d6a76-f07f-4f9a-8abc-5bfb4c54978f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:05:25.273289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:25.274330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:25.275452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 609/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:25.280304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae79cac-2b44-4dfe-8676-b6ab6167de90 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:25.378151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae79cac-2b44-4dfe-8676-b6ab6167de90 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:25.412508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99e8f-d98a-487a-abdb-da676016fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:25.413180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99e8f-d98a-487a-abdb-da676016fd1d None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:25.413464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99e8f-d98a-487a-abdb-da676016fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:25.413743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99e8f-d98a-487a-abdb-da676016fd1d None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:25.414572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99e8f-d98a-487a-abdb-da676016fd1d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:25.414881 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99e8f-d98a-487a-abdb-da676016fd1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:25.416338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99e8f-d98a-487a-abdb-da676016fd1d None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:25.433325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 604/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Jun 2 13:05:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:25.438983 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d6a76-f07f-4f9a-8abc-5bfb4c54978f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:25.540578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d6a76-f07f-4f9a-8abc-5bfb4c54978f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:25.573927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a517204-b466-470d-8f75-152239e0af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:25.574575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a517204-b466-470d-8f75-152239e0af31 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:25.574859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a517204-b466-470d-8f75-152239e0af31 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:25.575137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a517204-b466-470d-8f75-152239e0af31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:25.604530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:25.640169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a517204-b466-470d-8f75-152239e0af31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:25.641668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a517204-b466-470d-8f75-152239e0af31 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:25.735694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 610/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:05:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:05:25.742250 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99e8f-d98a-487a-abdb-da676016fd1d None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:25.760682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:25.838418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99e8f-d98a-487a-abdb-da676016fd1d None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:25.872661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd108be-12b4-4893-b587-da6b4b4b1cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:25.873562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd108be-12b4-4893-b587-da6b4b4b1cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:25.873847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd108be-12b4-4893-b587-da6b4b4b1cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:25.874117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd108be-12b4-4893-b587-da6b4b4b1cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:25.884084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd108be-12b4-4893-b587-da6b4b4b1cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:25.885509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd108be-12b4-4893-b587-da6b4b4b1cb0 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-2dd108be-12b4-4893-b587-da6b4b4b1cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:25.902928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:25.904004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:25.905121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:25.905121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:25.905121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:25.905121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:25.905121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 605/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:25.909852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a517204-b466-470d-8f75-152239e0af31 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:25.970219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:26.006674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a517204-b466-470d-8f75-152239e0af31 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:26.039790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c0ffb-2a66-4164-a532-6ff8fecdd12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:26.040475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c0ffb-2a66-4164-a532-6ff8fecdd12e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:26.040760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c0ffb-2a66-4164-a532-6ff8fecdd12e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:26.041034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c0ffb-2a66-4164-a532-6ff8fecdd12e None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:26.041742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c0ffb-2a66-4164-a532-6ff8fecdd12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:26.042045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c0ffb-2a66-4164-a532-6ff8fecdd12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:26.043413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c0ffb-2a66-4164-a532-6ff8fecdd12e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:26.054851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 611/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:26.060430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd108be-12b4-4893-b587-da6b4b4b1cb0 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:26.128225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:26.157835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd108be-12b4-4893-b587-da6b4b4b1cb0 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:26.191779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a9ec9-47c5-48fd-bae9-934eb315b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:26.193121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a9ec9-47c5-48fd-bae9-934eb315b94c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:26.193404 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a9ec9-47c5-48fd-bae9-934eb315b94c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:26.193678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a9ec9-47c5-48fd-bae9-934eb315b94c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:26.200183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a9ec9-47c5-48fd-bae9-934eb315b94c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:26.201699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a9ec9-47c5-48fd-bae9-934eb315b94c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-712a9ec9-47c5-48fd-bae9-934eb315b94c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:05:26.215774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:26.216908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:26.217988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:05:26.217988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:05:26.217988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:05:26.217988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:05:26.217988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:05:26.217988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:05:26.217988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:26.217988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:26.217988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 606/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:26.222864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c0ffb-2a66-4164-a532-6ff8fecdd12e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:26.320925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c0ffb-2a66-4164-a532-6ff8fecdd12e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:26.343439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:26.354539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603c431-d539-42b0-b216-68f85b89b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:26.355429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603c431-d539-42b0-b216-68f85b89b1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:26.355932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603c431-d539-42b0-b216-68f85b89b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:26.356217 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603c431-d539-42b0-b216-68f85b89b1a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:26.356998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603c431-d539-42b0-b216-68f85b89b1a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:26.357314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603c431-d539-42b0-b216-68f85b89b1a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:26.358980 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603c431-d539-42b0-b216-68f85b89b1a6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:26.370444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 612/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:26.379378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a9ec9-47c5-48fd-bae9-934eb315b94c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:26.477294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a9ec9-47c5-48fd-bae9-934eb315b94c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:26.503916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:26.509714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f8dcd-181a-4e7b-9e83-2d85201f7730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:26.510367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f8dcd-181a-4e7b-9e83-2d85201f7730 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:26.510651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f8dcd-181a-4e7b-9e83-2d85201f7730 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:26.510930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f8dcd-181a-4e7b-9e83-2d85201f7730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:26.511755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f8dcd-181a-4e7b-9e83-2d85201f7730 None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=cc0624612b2a4b1683a638b7ce4ca0f1) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:26.512095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f8dcd-181a-4e7b-9e83-2d85201f7730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:26.513519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f8dcd-181a-4e7b-9e83-2d85201f7730 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:26.518805 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 607/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:05:26 2022] GET /identity/v3/role_assignments?user.id=cc0624612b2a4b1683a638b7ce4ca0f1&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:28.735385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3807c4-6adf-4e3d-a605-ee081255a8f0 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:28.736001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3807c4-6adf-4e3d-a605-ee081255a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:28.736001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3807c4-6adf-4e3d-a605-ee081255a8f0 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:28.737240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 613/1220] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:05:28.743480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7752b8a-af84-4460-a79c-98b50ba9618a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:28.744085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7752b8a-af84-4460-a79c-98b50ba9618a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:28.744196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7752b8a-af84-4460-a79c-98b50ba9618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:28.763027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b7752b8a-af84-4460-a79c-98b50ba9618a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:28.765433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b7752b8a-af84-4460-a79c-98b50ba9618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:28.832722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 608/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:05:28.859477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3807c4-6adf-4e3d-a605-ee081255a8f0 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:28.961536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3807c4-6adf-4e3d-a605-ee081255a8f0 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:29.002022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b649bd-c923-4dc5-b994-a0c0742a0f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:29.002904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b649bd-c923-4dc5-b994-a0c0742a0f17 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:29.003254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b649bd-c923-4dc5-b994-a0c0742a0f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:29.003602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b649bd-c923-4dc5-b994-a0c0742a0f17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:29.015674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b649bd-c923-4dc5-b994-a0c0742a0f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-18b649bd-c923-4dc5-b994-a0c0742a0f17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:05:29.025436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:29.026558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:29.027498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 614/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:05:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:29.033365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7752b8a-af84-4460-a79c-98b50ba9618a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:29.132917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7752b8a-af84-4460-a79c-98b50ba9618a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:29.159825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:29.171938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6ca2c-841b-4367-a48f-9815cd906739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:29.172617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6ca2c-841b-4367-a48f-9815cd906739 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:29.172904 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6ca2c-841b-4367-a48f-9815cd906739 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:29.173183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6ca2c-841b-4367-a48f-9815cd906739 None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:29.173930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6ca2c-841b-4367-a48f-9815cd906739 None admin] RBAC: Adding query filter params (name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:29.174239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6ca2c-841b-4367-a48f-9815cd906739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:29.175598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6ca2c-841b-4367-a48f-9815cd906739 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:29.183516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 609/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:05:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:29.189606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b649bd-c923-4dc5-b994-a0c0742a0f17 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:29.237256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:29.292626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b649bd-c923-4dc5-b994-a0c0742a0f17 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:29.325732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494f64-594d-449d-93df-452c5cb21aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:29.326609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494f64-594d-449d-93df-452c5cb21aea None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:29.326900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494f64-594d-449d-93df-452c5cb21aea None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:29.327173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494f64-594d-449d-93df-452c5cb21aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:29.339627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77494f64-594d-449d-93df-452c5cb21aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:29.341757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77494f64-594d-449d-93df-452c5cb21aea None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-77494f64-594d-449d-93df-452c5cb21aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:29.359565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:29.360651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:29.361553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:29.361553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:29.361553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:29.361553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:29.361553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 615/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:29.367083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6ca2c-841b-4367-a48f-9815cd906739 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:29.481268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6ca2c-841b-4367-a48f-9815cd906739 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:29.528812 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973cf09-6480-4068-969c-2e11c3e4c834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:29.529487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973cf09-6480-4068-969c-2e11c3e4c834 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:29.529766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973cf09-6480-4068-969c-2e11c3e4c834 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:29.530038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973cf09-6480-4068-969c-2e11c3e4c834 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:29.530753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973cf09-6480-4068-969c-2e11c3e4c834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:29.531057 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973cf09-6480-4068-969c-2e11c3e4c834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:29.532457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973cf09-6480-4068-969c-2e11c3e4c834 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:29.544408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 610/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:05:29.550214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494f64-594d-449d-93df-452c5cb21aea None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:29.646067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:29.653382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494f64-594d-449d-93df-452c5cb21aea None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:29.686617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e490-f5ce-40a0-a46b-c44b5db4d21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:29.687418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e490-f5ce-40a0-a46b-c44b5db4d21a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:29.687701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e490-f5ce-40a0-a46b-c44b5db4d21a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:29.688007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e490-f5ce-40a0-a46b-c44b5db4d21a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:29.696120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48e490-f5ce-40a0-a46b-c44b5db4d21a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:29.697552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48e490-f5ce-40a0-a46b-c44b5db4d21a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-ab48e490-f5ce-40a0-a46b-c44b5db4d21a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:05:29.711740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:29.712855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:29.714173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 616/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:29.719647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973cf09-6480-4068-969c-2e11c3e4c834 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:29.772949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:29.825558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973cf09-6480-4068-969c-2e11c3e4c834 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:29.860110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc4689-41bf-4ea4-ad9d-22770afb16bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:29.860757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc4689-41bf-4ea4-ad9d-22770afb16bc None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:29.861037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc4689-41bf-4ea4-ad9d-22770afb16bc None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:29.861310 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc4689-41bf-4ea4-ad9d-22770afb16bc None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:29.862138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc4689-41bf-4ea4-ad9d-22770afb16bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:29.862448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc4689-41bf-4ea4-ad9d-22770afb16bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:29.863969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc4689-41bf-4ea4-ad9d-22770afb16bc None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:29.883061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 611/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Jun 2 13:05:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:29.888798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e490-f5ce-40a0-a46b-c44b5db4d21a None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:30.000275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e490-f5ce-40a0-a46b-c44b5db4d21a None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:30.033617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bf94a-0f4f-43e2-a79c-e6a4e7928287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:30.034423 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bf94a-0f4f-43e2-a79c-e6a4e7928287 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:30.034698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bf94a-0f4f-43e2-a79c-e6a4e7928287 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:30.034970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bf94a-0f4f-43e2-a79c-e6a4e7928287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:30.046227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bf94a-0f4f-43e2-a79c-e6a4e7928287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:30.047741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bf94a-0f4f-43e2-a79c-e6a4e7928287 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-a48bf94a-0f4f-43e2-a79c-e6a4e7928287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:30.065393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:30.066506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:30.067449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:30.067449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:30.067449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:30.067449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:30.067449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 617/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:05:30.072461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc4689-41bf-4ea4-ad9d-22770afb16bc None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:30.197189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc4689-41bf-4ea4-ad9d-22770afb16bc None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:30.199634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:30.230369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165298e-9f56-40b6-9530-b4c9d0d413e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:30.231036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165298e-9f56-40b6-9530-b4c9d0d413e1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:30.231315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165298e-9f56-40b6-9530-b4c9d0d413e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:30.231609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165298e-9f56-40b6-9530-b4c9d0d413e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:30.232337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165298e-9f56-40b6-9530-b4c9d0d413e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:30.232628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165298e-9f56-40b6-9530-b4c9d0d413e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:30.234244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165298e-9f56-40b6-9530-b4c9d0d413e1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:30.245821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 612/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:05:30.251561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bf94a-0f4f-43e2-a79c-e6a4e7928287 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:30.261905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:30.366518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bf94a-0f4f-43e2-a79c-e6a4e7928287 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:30.402515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d147a7-4494-4094-be1f-4042f91b5899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:30.403352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d147a7-4494-4094-be1f-4042f91b5899 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:30.403634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d147a7-4494-4094-be1f-4042f91b5899 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:30.403928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d147a7-4494-4094-be1f-4042f91b5899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:30.410684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d147a7-4494-4094-be1f-4042f91b5899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:30.412795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d147a7-4494-4094-be1f-4042f91b5899 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-b5d147a7-4494-4094-be1f-4042f91b5899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:05:30.426639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:30.430268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:30.431372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:05:30.431372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:05:30.431372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:05:30.431372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:05:30.431372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:05:30.431372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:05:30.431372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:30.431372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:30.431372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 618/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:30.434958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165298e-9f56-40b6-9530-b4c9d0d413e1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:30.534476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165298e-9f56-40b6-9530-b4c9d0d413e1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:30.568264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5f118-5076-4588-8d87-11b367b47f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:30.568928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5f118-5076-4588-8d87-11b367b47f46 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:30.569209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5f118-5076-4588-8d87-11b367b47f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:30.569481 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5f118-5076-4588-8d87-11b367b47f46 None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:30.570261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5f118-5076-4588-8d87-11b367b47f46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:30.570569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5f118-5076-4588-8d87-11b367b47f46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:30.572056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5f118-5076-4588-8d87-11b367b47f46 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:30.584454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 613/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:05:30.591357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d147a7-4494-4094-be1f-4042f91b5899 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:30.657882 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:30.692252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d147a7-4494-4094-be1f-4042f91b5899 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:30.727510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5fd83-8cb1-4e68-addf-5e805847a1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:30.728485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fd83-8cb1-4e68-addf-5e805847a1f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:30.728772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fd83-8cb1-4e68-addf-5e805847a1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:30.729039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5fd83-8cb1-4e68-addf-5e805847a1f4 None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/cc0624612b2a4b1683a638b7ce4ca0f1/roles/268a1d65ee224ca3b6b59f003f936207` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:30.743812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5fd83-8cb1-4e68-addf-5e805847a1f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=cc0624612b2a4b1683a638b7ce4ca0f1, role_id=268a1d65ee224ca3b6b59f003f936207)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:30.745307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5fd83-8cb1-4e68-addf-5e805847a1f4 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:30.785075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 619/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:05:30 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/cc0624612b2a4b1683a638b7ce4ca0f1/roles/268a1d65ee224ca3b6b59f003f936207 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:05:33.108714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e9f8e-2519-490e-a7bb-bb043f8b70ae None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:33.109488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e9f8e-2519-490e-a7bb-bb043f8b70ae None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:33.109645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e9f8e-2519-490e-a7bb-bb043f8b70ae None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:33.110916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 614/1233] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:05:33.117095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7f65a-95b7-46c5-a62a-dbd390c1160d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:33.117519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7f65a-95b7-46c5-a62a-dbd390c1160d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:33.117627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7f65a-95b7-46c5-a62a-dbd390c1160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:33.138580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d8e7f65a-95b7-46c5-a62a-dbd390c1160d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:33.139830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d8e7f65a-95b7-46c5-a62a-dbd390c1160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:33.212453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 620/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:05:33.238499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e9f8e-2519-490e-a7bb-bb043f8b70ae None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:33.265728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:33.341740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e9f8e-2519-490e-a7bb-bb043f8b70ae None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:33.374576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad320d9-7a72-4646-97aa-0c74758a0091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:33.375302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad320d9-7a72-4646-97aa-0c74758a0091 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:33.375578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad320d9-7a72-4646-97aa-0c74758a0091 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:33.375845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad320d9-7a72-4646-97aa-0c74758a0091 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:33.387832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad320d9-7a72-4646-97aa-0c74758a0091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-aad320d9-7a72-4646-97aa-0c74758a0091 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:05:33.396138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:33.397230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:33.398126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 615/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Thu Jun 2 13:05:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:33.403717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7f65a-95b7-46c5-a62a-dbd390c1160d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:33.448416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:33.501605 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7f65a-95b7-46c5-a62a-dbd390c1160d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:33.534097 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fdbe2-369c-4eb6-b889-31574d495ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:33.534764 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fdbe2-369c-4eb6-b889-31574d495ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:33.535046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fdbe2-369c-4eb6-b889-31574d495ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:33.535320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fdbe2-369c-4eb6-b889-31574d495ec6 None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:33.536094 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fdbe2-369c-4eb6-b889-31574d495ec6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:33.537103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fdbe2-369c-4eb6-b889-31574d495ec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:33.538520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fdbe2-369c-4eb6-b889-31574d495ec6 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:33.547969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 621/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Thu Jun 2 13:05:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:33.554520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad320d9-7a72-4646-97aa-0c74758a0091 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:33.652895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:33.668544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad320d9-7a72-4646-97aa-0c74758a0091 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:33.701704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c7141-5f7b-4ba6-a372-5c6ee4cecb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:33.702491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7141-5f7b-4ba6-a372-5c6ee4cecb4e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:33.702785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7141-5f7b-4ba6-a372-5c6ee4cecb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:33.703049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7141-5f7b-4ba6-a372-5c6ee4cecb4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:33.714367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c7141-5f7b-4ba6-a372-5c6ee4cecb4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:33.715864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c7141-5f7b-4ba6-a372-5c6ee4cecb4e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-5f9c7141-5f7b-4ba6-a372-5c6ee4cecb4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:33.732646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:33.733732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:33.739674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:33.739674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:33.739674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:33.739674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:33.739674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 616/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:33.740137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fdbe2-369c-4eb6-b889-31574d495ec6 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:33.837274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fdbe2-369c-4eb6-b889-31574d495ec6 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:33.846509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:33.870755 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27fbaa-76d2-4423-b5f2-0b2a5a02996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:33.871416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27fbaa-76d2-4423-b5f2-0b2a5a02996c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:33.871695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27fbaa-76d2-4423-b5f2-0b2a5a02996c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:33.872011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27fbaa-76d2-4423-b5f2-0b2a5a02996c None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:33.872716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27fbaa-76d2-4423-b5f2-0b2a5a02996c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:33.873924 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27fbaa-76d2-4423-b5f2-0b2a5a02996c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:33.874554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27fbaa-76d2-4423-b5f2-0b2a5a02996c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:33.886117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 622/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:33.891866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c7141-5f7b-4ba6-a372-5c6ee4cecb4e None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:33.989435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c7141-5f7b-4ba6-a372-5c6ee4cecb4e None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:34.021994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c683fd4-3db4-490f-937b-0ce573ff91bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:34.022782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c683fd4-3db4-490f-937b-0ce573ff91bc None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:34.023090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c683fd4-3db4-490f-937b-0ce573ff91bc None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:34.023322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c683fd4-3db4-490f-937b-0ce573ff91bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:34.027095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:34.032112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c683fd4-3db4-490f-937b-0ce573ff91bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:34.033551 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c683fd4-3db4-490f-937b-0ce573ff91bc None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-3c683fd4-3db4-490f-937b-0ce573ff91bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:05:34.047755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:34.048912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:34.050073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 617/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:34.055375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27fbaa-76d2-4423-b5f2-0b2a5a02996c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:34.159196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27fbaa-76d2-4423-b5f2-0b2a5a02996c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:34.199378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0266013-fa46-4248-8e7b-8dce74ba9f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:34.199378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0266013-fa46-4248-8e7b-8dce74ba9f16 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:34.199378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0266013-fa46-4248-8e7b-8dce74ba9f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:34.199378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0266013-fa46-4248-8e7b-8dce74ba9f16 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:34.199854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0266013-fa46-4248-8e7b-8dce74ba9f16 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:34.199854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0266013-fa46-4248-8e7b-8dce74ba9f16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:34.200310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0266013-fa46-4248-8e7b-8dce74ba9f16 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:34.217763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 623/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Jun 2 13:05:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:05:34.223478 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c683fd4-3db4-490f-937b-0ce573ff91bc None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:34.325405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c683fd4-3db4-490f-937b-0ce573ff91bc None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:34.358448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8c6f5-f586-44ec-8ee4-60a3879c07f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:34.359446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c6f5-f586-44ec-8ee4-60a3879c07f9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:34.359764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c6f5-f586-44ec-8ee4-60a3879c07f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:34.360033 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c6f5-f586-44ec-8ee4-60a3879c07f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:34.430882 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:34.437259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8c6f5-f586-44ec-8ee4-60a3879c07f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:34.438710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8c6f5-f586-44ec-8ee4-60a3879c07f9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:34.539698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 618/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:05:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:05:34.546562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0266013-fa46-4248-8e7b-8dce74ba9f16 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:34.574286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:34.647132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0266013-fa46-4248-8e7b-8dce74ba9f16 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:34.680502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c6f7a-7626-4c2b-b139-45ce30977b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:34.681300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6f7a-7626-4c2b-b139-45ce30977b07 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:34.681574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6f7a-7626-4c2b-b139-45ce30977b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:34.681846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6f7a-7626-4c2b-b139-45ce30977b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:34.691532 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c6f7a-7626-4c2b-b139-45ce30977b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:34.693043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c6f7a-7626-4c2b-b139-45ce30977b07 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-2b5c6f7a-7626-4c2b-b139-45ce30977b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:34.710060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:34.715188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:34.716300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:34.716300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:34.716300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:34.716300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:34.716300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 624/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:34.717027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8c6f5-f586-44ec-8ee4-60a3879c07f9 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:34.817649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:34.823255 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8c6f5-f586-44ec-8ee4-60a3879c07f9 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:34.856862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6b6b7-1ed2-490a-a253-526ff2c248d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:34.857545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b6b7-1ed2-490a-a253-526ff2c248d8 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:34.857827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b6b7-1ed2-490a-a253-526ff2c248d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:34.858099 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b6b7-1ed2-490a-a253-526ff2c248d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:34.859056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6b6b7-1ed2-490a-a253-526ff2c248d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:34.859361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6b6b7-1ed2-490a-a253-526ff2c248d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:34.860744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6b6b7-1ed2-490a-a253-526ff2c248d8 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:34.871572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 619/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:34.877784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c6f7a-7626-4c2b-b139-45ce30977b07 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:34.955665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:34.977336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c6f7a-7626-4c2b-b139-45ce30977b07 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:35.009944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cc278-66f5-4b98-858d-72b55c379c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:35.010735 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cc278-66f5-4b98-858d-72b55c379c26 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:35.011045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cc278-66f5-4b98-858d-72b55c379c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:35.011284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cc278-66f5-4b98-858d-72b55c379c26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:35.017806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cc278-66f5-4b98-858d-72b55c379c26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:35.019261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cc278-66f5-4b98-858d-72b55c379c26 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-6b5cc278-66f5-4b98-858d-72b55c379c26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:05:35.033306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:35.034362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:35.035718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:05:35.035718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:05:35.035718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:05:35.035718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:05:35.035718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:05:35.035718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:05:35.035718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:35.035718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:35.035718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 625/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:35.041371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6b6b7-1ed2-490a-a253-526ff2c248d8 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:35.144944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6b6b7-1ed2-490a-a253-526ff2c248d8 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:35.178046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7da32-49b4-48a4-a248-5d136d9c1afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:35.178790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7da32-49b4-48a4-a248-5d136d9c1afc None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:35.179078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7da32-49b4-48a4-a248-5d136d9c1afc None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:35.179369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7da32-49b4-48a4-a248-5d136d9c1afc None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:35.180181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7da32-49b4-48a4-a248-5d136d9c1afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:35.180485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7da32-49b4-48a4-a248-5d136d9c1afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:35.181900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7da32-49b4-48a4-a248-5d136d9c1afc None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:35.194070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 620/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:35.200172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cc278-66f5-4b98-858d-72b55c379c26 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:35.299917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cc278-66f5-4b98-858d-72b55c379c26 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:35.334066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03c89d-c0b0-41e6-8a3c-c1574174ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:35.334721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03c89d-c0b0-41e6-8a3c-c1574174ce72 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:35.335000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03c89d-c0b0-41e6-8a3c-c1574174ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:35.335271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03c89d-c0b0-41e6-8a3c-c1574174ce72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:35.336169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03c89d-c0b0-41e6-8a3c-c1574174ce72 None admin] RBAC: Adding query filter params (role.id=268a1d65ee224ca3b6b59f003f936207, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=cc0624612b2a4b1683a638b7ce4ca0f1) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:35.336483 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03c89d-c0b0-41e6-8a3c-c1574174ce72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:35.337997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03c89d-c0b0-41e6-8a3c-c1574174ce72 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:35.343689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 626/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:05:35 2022] GET /identity/v3/role_assignments?user.id=cc0624612b2a4b1683a638b7ce4ca0f1&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=268a1d65ee224ca3b6b59f003f936207 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:37.642863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e803-4893-4eee-9f27-935e27b000e7 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:37.643383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e803-4893-4eee-9f27-935e27b000e7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:37.643471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e803-4893-4eee-9f27-935e27b000e7 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:37.644803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 621/1247] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:05:37.650698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04993036-2845-4afc-98c1-54aa9c701c47 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:37.651130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04993036-2845-4afc-98c1-54aa9c701c47 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:37.651221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04993036-2845-4afc-98c1-54aa9c701c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:37.656435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:37.668509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-04993036-2845-4afc-98c1-54aa9c701c47 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:37.669738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-04993036-2845-4afc-98c1-54aa9c701c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:37.738718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 627/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:05:37.762475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e803-4893-4eee-9f27-935e27b000e7 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:37.780891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:37.861753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e803-4893-4eee-9f27-935e27b000e7 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:37.897306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d5ef4-c95e-42b7-9b65-ddd4d47aa7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:37.898099 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5ef4-c95e-42b7-9b65-ddd4d47aa7fc None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:37.898385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5ef4-c95e-42b7-9b65-ddd4d47aa7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:37.898681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5ef4-c95e-42b7-9b65-ddd4d47aa7fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:37.908620 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d5ef4-c95e-42b7-9b65-ddd4d47aa7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-504d5ef4-c95e-42b7-9b65-ddd4d47aa7fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:05:37.916217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:37.917195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:37.918031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 622/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:05:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:37.924217 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04993036-2845-4afc-98c1-54aa9c701c47 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:38.022476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04993036-2845-4afc-98c1-54aa9c701c47 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:38.050565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:38.056294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1206-e03a-44d8-97c4-9919e39682cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:38.058137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1206-e03a-44d8-97c4-9919e39682cd None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:38.058454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1206-e03a-44d8-97c4-9919e39682cd None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:38.058776 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1206-e03a-44d8-97c4-9919e39682cd None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:38.059590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b1206-e03a-44d8-97c4-9919e39682cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:38.059944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b1206-e03a-44d8-97c4-9919e39682cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:38.061466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b1206-e03a-44d8-97c4-9919e39682cd None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:38.070633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 628/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:05:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:38.076778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d5ef4-c95e-42b7-9b65-ddd4d47aa7fc None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:38.154337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:38.178000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d5ef4-c95e-42b7-9b65-ddd4d47aa7fc None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:38.209921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa35c7-b038-47b1-8379-dfe7055c45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:38.210716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa35c7-b038-47b1-8379-dfe7055c45f1 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:38.210997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa35c7-b038-47b1-8379-dfe7055c45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:38.211269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa35c7-b038-47b1-8379-dfe7055c45f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:38.221994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa35c7-b038-47b1-8379-dfe7055c45f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:38.223450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa35c7-b038-47b1-8379-dfe7055c45f1 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-4dfa35c7-b038-47b1-8379-dfe7055c45f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:38.241224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:38.242442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:38.243544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:38.243544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:38.243544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:38.243544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:38.243544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 623/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:38.248292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1206-e03a-44d8-97c4-9919e39682cd None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:38.350117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1206-e03a-44d8-97c4-9919e39682cd None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:38.383548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093f79e-2abd-439c-b822-9c9dc570e178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:38.384283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f79e-2abd-439c-b822-9c9dc570e178 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:38.384565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f79e-2abd-439c-b822-9c9dc570e178 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:38.384837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f79e-2abd-439c-b822-9c9dc570e178 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:38.385559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093f79e-2abd-439c-b822-9c9dc570e178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:38.385865 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093f79e-2abd-439c-b822-9c9dc570e178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:38.387254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093f79e-2abd-439c-b822-9c9dc570e178 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:38.400024 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 629/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:38.405695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa35c7-b038-47b1-8379-dfe7055c45f1 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:38.506366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa35c7-b038-47b1-8379-dfe7055c45f1 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:38.534362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:38.542534 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f66b06-a79e-4365-bcef-8b53a509fda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:38.543334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f66b06-a79e-4365-bcef-8b53a509fda7 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:38.543619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f66b06-a79e-4365-bcef-8b53a509fda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:38.543935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f66b06-a79e-4365-bcef-8b53a509fda7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:38.551257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f66b06-a79e-4365-bcef-8b53a509fda7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:38.553281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f66b06-a79e-4365-bcef-8b53a509fda7 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-98f66b06-a79e-4365-bcef-8b53a509fda7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:05:38.567593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:38.568811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:38.570103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 624/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:38.575945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093f79e-2abd-439c-b822-9c9dc570e178 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:38.630918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:38.677383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093f79e-2abd-439c-b822-9c9dc570e178 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:38.710928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df59a5f-9922-4643-a613-85ff422b07f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:38.711615 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59a5f-9922-4643-a613-85ff422b07f9 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:38.711900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59a5f-9922-4643-a613-85ff422b07f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:38.712168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df59a5f-9922-4643-a613-85ff422b07f9 None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:38.713001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df59a5f-9922-4643-a613-85ff422b07f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:38.713306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df59a5f-9922-4643-a613-85ff422b07f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:38.714719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df59a5f-9922-4643-a613-85ff422b07f9 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:38.732721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 630/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Jun 2 13:05:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:38.738782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f66b06-a79e-4365-bcef-8b53a509fda7 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:38.838540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f66b06-a79e-4365-bcef-8b53a509fda7 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:38.876448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba56291-9b8c-4fcd-865e-ba9b2ff41ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:38.877097 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba56291-9b8c-4fcd-865e-ba9b2ff41ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:38.877379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba56291-9b8c-4fcd-865e-ba9b2ff41ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:38.877653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba56291-9b8c-4fcd-865e-ba9b2ff41ed5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:38.933238 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:38.945640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba56291-9b8c-4fcd-865e-ba9b2ff41ed5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:38.947076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba56291-9b8c-4fcd-865e-ba9b2ff41ed5 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:39.050477 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 625/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:05:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:05:39.056703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df59a5f-9922-4643-a613-85ff422b07f9 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:39.160219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df59a5f-9922-4643-a613-85ff422b07f9 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:39.173027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:39.196121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ea2b-194c-48b2-9ef4-e943d174ea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:39.197075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ea2b-194c-48b2-9ef4-e943d174ea63 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:39.197400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ea2b-194c-48b2-9ef4-e943d174ea63 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:39.197738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ea2b-194c-48b2-9ef4-e943d174ea63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:39.210435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194ea2b-194c-48b2-9ef4-e943d174ea63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:39.211914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194ea2b-194c-48b2-9ef4-e943d174ea63 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-7194ea2b-194c-48b2-9ef4-e943d174ea63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:39.229578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:39.230640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:39.231622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:39.231622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:39.231622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:39.231622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:39.231622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 631/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:39.238027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba56291-9b8c-4fcd-865e-ba9b2ff41ed5 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:39.332837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:39.345003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba56291-9b8c-4fcd-865e-ba9b2ff41ed5 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:39.379333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3454-d0ec-463e-9f8a-05a792b33498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:39.380654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3454-d0ec-463e-9f8a-05a792b33498 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:39.380937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3454-d0ec-463e-9f8a-05a792b33498 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:39.381214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3454-d0ec-463e-9f8a-05a792b33498 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:39.381933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd3454-d0ec-463e-9f8a-05a792b33498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:39.382241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd3454-d0ec-463e-9f8a-05a792b33498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:39.383631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd3454-d0ec-463e-9f8a-05a792b33498 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:39.395329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 626/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:39.401600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ea2b-194c-48b2-9ef4-e943d174ea63 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:39.517599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ea2b-194c-48b2-9ef4-e943d174ea63 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:39.552324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec57839-66c7-499a-ba41-07a544be573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:39.553107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec57839-66c7-499a-ba41-07a544be573d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:39.553388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec57839-66c7-499a-ba41-07a544be573d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:39.553664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec57839-66c7-499a-ba41-07a544be573d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:39.560146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec57839-66c7-499a-ba41-07a544be573d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:39.561723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec57839-66c7-499a-ba41-07a544be573d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-4ec57839-66c7-499a-ba41-07a544be573d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:05:39.575001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:39.580145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:39.581249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:05:39.581249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:05:39.581249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:05:39.581249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:05:39.581249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:05:39.581249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:05:39.581249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:39.581249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:39.581249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 632/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:39.583680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3454-d0ec-463e-9f8a-05a792b33498 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:39.683303 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3454-d0ec-463e-9f8a-05a792b33498 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:39.717339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0c572-2a10-424a-a26f-3d4f25f8a86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:39.718004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0c572-2a10-424a-a26f-3d4f25f8a86e None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:39.718289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0c572-2a10-424a-a26f-3d4f25f8a86e None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:39.718572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0c572-2a10-424a-a26f-3d4f25f8a86e None admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:39.719359 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0c572-2a10-424a-a26f-3d4f25f8a86e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:39.719669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0c572-2a10-424a-a26f-3d4f25f8a86e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:39.721139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0c572-2a10-424a-a26f-3d4f25f8a86e None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:39.733572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 627/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:05:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:39.741834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec57839-66c7-499a-ba41-07a544be573d None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:39.766214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:39.839110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec57839-66c7-499a-ba41-07a544be573d None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:39.874763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38501637-d8be-4250-b53a-5af1460b395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:39.875496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501637-d8be-4250-b53a-5af1460b395a None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:39.875785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501637-d8be-4250-b53a-5af1460b395a None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:39.876100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501637-d8be-4250-b53a-5af1460b395a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:39.876967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38501637-d8be-4250-b53a-5af1460b395a None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=cc0624612b2a4b1683a638b7ce4ca0f1) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:39.877278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38501637-d8be-4250-b53a-5af1460b395a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:39.878758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38501637-d8be-4250-b53a-5af1460b395a None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:39.885538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 633/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:05:39 2022] GET /identity/v3/role_assignments?user.id=cc0624612b2a4b1683a638b7ce4ca0f1&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=31c5600d1f984a04827cf0052fc61678 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:42.123542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b174f-8c15-4ad1-93e7-47bf1d3219ee None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:42.124105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b174f-8c15-4ad1-93e7-47bf1d3219ee None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:42.124105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b174f-8c15-4ad1-93e7-47bf1d3219ee None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:42.125487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 628/1261] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:05:42.131073 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852df9-77c8-4d47-85a3-a25c5f5a071e None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:42.131516 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852df9-77c8-4d47-85a3-a25c5f5a071e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:42.131661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852df9-77c8-4d47-85a3-a25c5f5a071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:42.276811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-43852df9-77c8-4d47-85a3-a25c5f5a071e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:42.278016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-43852df9-77c8-4d47-85a3-a25c5f5a071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:42.343690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 634/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:05:42.367740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b174f-8c15-4ad1-93e7-47bf1d3219ee None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:42.379289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:42.471961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b174f-8c15-4ad1-93e7-47bf1d3219ee None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:42.508218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654720c-1118-4c5b-a460-5b3321ee82a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:42.509016 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654720c-1118-4c5b-a460-5b3321ee82a3 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:42.509295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654720c-1118-4c5b-a460-5b3321ee82a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:42.509565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654720c-1118-4c5b-a460-5b3321ee82a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:42.520246 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654720c-1118-4c5b-a460-5b3321ee82a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-d654720c-1118-4c5b-a460-5b3321ee82a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:05:42.528612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:42.529821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:42.532186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 629/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:05:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:42.537951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43852df9-77c8-4d47-85a3-a25c5f5a071e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:42.558263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:42.651716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43852df9-77c8-4d47-85a3-a25c5f5a071e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:42.684820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6aff4-6c43-4997-9a1b-fd27da61be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:42.685491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6aff4-6c43-4997-9a1b-fd27da61be4b None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:42.685774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6aff4-6c43-4997-9a1b-fd27da61be4b None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:42.686050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6aff4-6c43-4997-9a1b-fd27da61be4b None admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:42.686797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6aff4-6c43-4997-9a1b-fd27da61be4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:42.687099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6aff4-6c43-4997-9a1b-fd27da61be4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:42.688490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6aff4-6c43-4997-9a1b-fd27da61be4b None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:42.697266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 635/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:05:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:42.703441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654720c-1118-4c5b-a460-5b3321ee82a3 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:42.777644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:42.813338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654720c-1118-4c5b-a460-5b3321ee82a3 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:42.846916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcc8c6-437f-40ab-97ac-6a9aebfe479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:42.847714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcc8c6-437f-40ab-97ac-6a9aebfe479c None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:42.848036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcc8c6-437f-40ab-97ac-6a9aebfe479c None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:42.848314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcc8c6-437f-40ab-97ac-6a9aebfe479c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:42.858499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcc8c6-437f-40ab-97ac-6a9aebfe479c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:42.860239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcc8c6-437f-40ab-97ac-6a9aebfe479c None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-d5bcc8c6-437f-40ab-97ac-6a9aebfe479c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:42.877029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:42.887008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:42.888823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:42.888823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:42.888823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:42.888823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:42.888823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 630/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:42.889473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6aff4-6c43-4997-9a1b-fd27da61be4b None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:42.973972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:42.992666 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6aff4-6c43-4997-9a1b-fd27da61be4b None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:43.026178 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75212-60fb-486c-95a8-f07a4b8b52d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:43.026840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75212-60fb-486c-95a8-f07a4b8b52d7 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:43.027124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75212-60fb-486c-95a8-f07a4b8b52d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:43.027402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75212-60fb-486c-95a8-f07a4b8b52d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:43.028146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f75212-60fb-486c-95a8-f07a4b8b52d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:43.028456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f75212-60fb-486c-95a8-f07a4b8b52d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:43.029918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f75212-60fb-486c-95a8-f07a4b8b52d7 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:43.041444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 636/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:43.047300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcc8c6-437f-40ab-97ac-6a9aebfe479c None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:43.148613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcc8c6-437f-40ab-97ac-6a9aebfe479c None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:43.168365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:43.184298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716777-e7ed-4185-a090-c0f60b1403b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:43.185100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716777-e7ed-4185-a090-c0f60b1403b0 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:43.185381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716777-e7ed-4185-a090-c0f60b1403b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:43.185656 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716777-e7ed-4185-a090-c0f60b1403b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:43.193556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d716777-e7ed-4185-a090-c0f60b1403b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:43.195098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d716777-e7ed-4185-a090-c0f60b1403b0 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-6d716777-e7ed-4185-a090-c0f60b1403b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:05:43.209650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:43.211307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:43.212625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 631/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:43.217032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75212-60fb-486c-95a8-f07a4b8b52d7 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:43.318741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75212-60fb-486c-95a8-f07a4b8b52d7 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:43.355475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ea937-ec56-4f86-a1e2-1f212984686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:43.356156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea937-ec56-4f86-a1e2-1f212984686f None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:43.356439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea937-ec56-4f86-a1e2-1f212984686f None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:43.356713 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea937-ec56-4f86-a1e2-1f212984686f None admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:43.357553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ea937-ec56-4f86-a1e2-1f212984686f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:43.357865 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ea937-ec56-4f86-a1e2-1f212984686f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:43.359554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ea937-ec56-4f86-a1e2-1f212984686f None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:43.369003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:43.377780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 637/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Jun 2 13:05:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:05:43.383486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716777-e7ed-4185-a090-c0f60b1403b0 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:43.484874 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716777-e7ed-4185-a090-c0f60b1403b0 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:43.517930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70920c4c-2c26-46c4-a335-3f7eca5fd3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:43.518718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70920c4c-2c26-46c4-a335-3f7eca5fd3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:43.518999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70920c4c-2c26-46c4-a335-3f7eca5fd3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:43.519273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70920c4c-2c26-46c4-a335-3f7eca5fd3f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:43.530193 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70920c4c-2c26-46c4-a335-3f7eca5fd3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:43.531619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70920c4c-2c26-46c4-a335-3f7eca5fd3f6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-70920c4c-2c26-46c4-a335-3f7eca5fd3f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:43.549619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:43.550607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:43.551485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:43.551485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:43.551485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:43.551485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:43.551485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 632/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:43.557262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ea937-ec56-4f86-a1e2-1f212984686f None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:43.658231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ea937-ec56-4f86-a1e2-1f212984686f None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:43.693627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fff424-768d-4816-9055-8074871bb110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:43.694299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fff424-768d-4816-9055-8074871bb110 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:43.694574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fff424-768d-4816-9055-8074871bb110 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:43.694840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fff424-768d-4816-9055-8074871bb110 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:43.695553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fff424-768d-4816-9055-8074871bb110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:43.695852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fff424-768d-4816-9055-8074871bb110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:43.697249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fff424-768d-4816-9055-8074871bb110 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:43.709092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 638/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:43.715049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70920c4c-2c26-46c4-a335-3f7eca5fd3f6 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:43.745283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:43.813253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70920c4c-2c26-46c4-a335-3f7eca5fd3f6 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:43.845798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e4b98-db3a-4cb4-ac45-844fd8e1540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:43.846588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e4b98-db3a-4cb4-ac45-844fd8e1540f None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:43.846913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e4b98-db3a-4cb4-ac45-844fd8e1540f None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:43.847189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e4b98-db3a-4cb4-ac45-844fd8e1540f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:43.853756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e4b98-db3a-4cb4-ac45-844fd8e1540f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:43.855323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e4b98-db3a-4cb4-ac45-844fd8e1540f None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-355e4b98-db3a-4cb4-ac45-844fd8e1540f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:05:43.870048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:43.871192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:43.872709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:05:43.872709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:05:43.872709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:05:43.872709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:05:43.872709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:05:43.872709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:05:43.872709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:43.872709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:43.872709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 633/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:43.877626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fff424-768d-4816-9055-8074871bb110 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:43.937589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:43.979059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fff424-768d-4816-9055-8074871bb110 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:44.012620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a08f4-3eba-4395-873e-4cde494c9a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:44.013279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a08f4-3eba-4395-873e-4cde494c9a29 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:44.013562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a08f4-3eba-4395-873e-4cde494c9a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:44.013839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a08f4-3eba-4395-873e-4cde494c9a29 None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:44.014620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a08f4-3eba-4395-873e-4cde494c9a29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:44.014933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a08f4-3eba-4395-873e-4cde494c9a29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:44.016384 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a08f4-3eba-4395-873e-4cde494c9a29 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:44.028984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 639/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:44.038446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e4b98-db3a-4cb4-ac45-844fd8e1540f None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:44.125771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:44.134921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e4b98-db3a-4cb4-ac45-844fd8e1540f None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:44.168043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bbb96-f72b-49b2-b92e-1d5af1437484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:44.168939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bbb96-f72b-49b2-b92e-1d5af1437484 None admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:44.169220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bbb96-f72b-49b2-b92e-1d5af1437484 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:44.169514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bbb96-f72b-49b2-b92e-1d5af1437484 None admin] PATH_INFO: `/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/cc0624612b2a4b1683a638b7ce4ca0f1/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:44.171415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bbb96-f72b-49b2-b92e-1d5af1437484 None admin] RBAC: Authorizing `identity:create_grant(project_id=ade2eaaff64b415f8aeafd96a4e7ada8, user_id=cc0624612b2a4b1683a638b7ce4ca0f1, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:44.172886 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bbb96-f72b-49b2-b92e-1d5af1437484 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:44.243623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 634/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Thu Jun 2 13:05:44 2022] PUT /identity/v3/projects/ade2eaaff64b415f8aeafd96a4e7ada8/users/cc0624612b2a4b1683a638b7ce4ca0f1/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:05:46.464049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b127-5d03-4c42-922c-623e94464a79 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:46.464694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b127-5d03-4c42-922c-623e94464a79 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:46.464694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95b127-5d03-4c42-922c-623e94464a79 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:46.465986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 640/1274] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:05:46.472523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bfd73-0590-43a5-ad1a-ed6561f93bb2 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:46.478347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bfd73-0590-43a5-ad1a-ed6561f93bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:46.478347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bfd73-0590-43a5-ad1a-ed6561f93bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:46.492652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-df7bfd73-0590-43a5-ad1a-ed6561f93bb2 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:46.493898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-df7bfd73-0590-43a5-ad1a-ed6561f93bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:46.568883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 635/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:05:46.592997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95b127-5d03-4c42-922c-623e94464a79 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:46.720273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95b127-5d03-4c42-922c-623e94464a79 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:46.740732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:46.758601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cfc0a-6203-4714-a9a8-10ac4e991365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:46.759416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cfc0a-6203-4714-a9a8-10ac4e991365 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:46.759701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cfc0a-6203-4714-a9a8-10ac4e991365 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:46.760034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cfc0a-6203-4714-a9a8-10ac4e991365 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:46.771622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cfc0a-6203-4714-a9a8-10ac4e991365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-d94cfc0a-6203-4714-a9a8-10ac4e991365 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:05:46.779600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:46.782081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:05:46.783922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:46.785488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 641/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Thu Jun 2 13:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:46.787654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bfd73-0590-43a5-ad1a-ed6561f93bb2 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:46.877102 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:46.898180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bfd73-0590-43a5-ad1a-ed6561f93bb2 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:46.939866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4668db6-00cd-476b-8822-44514222b2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:46.940962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668db6-00cd-476b-8822-44514222b2fa None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:46.941323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668db6-00cd-476b-8822-44514222b2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:46.941663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668db6-00cd-476b-8822-44514222b2fa None admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:46.942557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4668db6-00cd-476b-8822-44514222b2fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:46.942952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4668db6-00cd-476b-8822-44514222b2fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:46.944805 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4668db6-00cd-476b-8822-44514222b2fa None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:46.955950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 636/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Thu Jun 2 13:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:46.962395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cfc0a-6203-4714-a9a8-10ac4e991365 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:47.071046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cfc0a-6203-4714-a9a8-10ac4e991365 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:47.104887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98a29c-2d08-4b38-85ab-332edc4dcd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:47.105682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a29c-2d08-4b38-85ab-332edc4dcd7c None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:47.105966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a29c-2d08-4b38-85ab-332edc4dcd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:47.106242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a29c-2d08-4b38-85ab-332edc4dcd7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:47.117321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98a29c-2d08-4b38-85ab-332edc4dcd7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:47.118763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98a29c-2d08-4b38-85ab-332edc4dcd7c None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-6c98a29c-2d08-4b38-85ab-332edc4dcd7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:47.135667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:47.136810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:47.137709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:47.137709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:47.137709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:47.137709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:47.137709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 642/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:47.143039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4668db6-00cd-476b-8822-44514222b2fa None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:47.242151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4668db6-00cd-476b-8822-44514222b2fa None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:47.275583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcef6d-964b-4870-98c0-97ef1d774031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:47.276377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcef6d-964b-4870-98c0-97ef1d774031 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:47.276703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcef6d-964b-4870-98c0-97ef1d774031 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:47.277015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcef6d-964b-4870-98c0-97ef1d774031 None admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:47.277782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcef6d-964b-4870-98c0-97ef1d774031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:47.278130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcef6d-964b-4870-98c0-97ef1d774031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:47.279540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcef6d-964b-4870-98c0-97ef1d774031 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:47.291330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 637/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:47.297021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98a29c-2d08-4b38-85ab-332edc4dcd7c None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:47.328194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:47.398730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98a29c-2d08-4b38-85ab-332edc4dcd7c None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:47.431475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639bf29-5e97-4b44-a7cd-4d6f2b349554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:47.432301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639bf29-5e97-4b44-a7cd-4d6f2b349554 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:47.432589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639bf29-5e97-4b44-a7cd-4d6f2b349554 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:47.432866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639bf29-5e97-4b44-a7cd-4d6f2b349554 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:47.440780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639bf29-5e97-4b44-a7cd-4d6f2b349554 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:47.444498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639bf29-5e97-4b44-a7cd-4d6f2b349554 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-9639bf29-5e97-4b44-a7cd-4d6f2b349554 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:05:47.457419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:47.462770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:47.464140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 643/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:47.467214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcef6d-964b-4870-98c0-97ef1d774031 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:47.471616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:47.568908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcef6d-964b-4870-98c0-97ef1d774031 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:47.601749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee07db9-28c4-4664-95ee-5e4290a1e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:47.602416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee07db9-28c4-4664-95ee-5e4290a1e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:47.602705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee07db9-28c4-4664-95ee-5e4290a1e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:47.602970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee07db9-28c4-4664-95ee-5e4290a1e1d0 None admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:47.603795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee07db9-28c4-4664-95ee-5e4290a1e1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:47.604128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee07db9-28c4-4664-95ee-5e4290a1e1d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:47.605810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee07db9-28c4-4664-95ee-5e4290a1e1d0 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:47.623764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 638/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Thu Jun 2 13:05:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:47.629839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639bf29-5e97-4b44-a7cd-4d6f2b349554 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:47.719733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:47.729109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639bf29-5e97-4b44-a7cd-4d6f2b349554 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:47.768316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86c2e4-6aa9-4259-a5d9-ad2bdbdb4dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:47.768961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86c2e4-6aa9-4259-a5d9-ad2bdbdb4dfe None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:47.769240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86c2e4-6aa9-4259-a5d9-ad2bdbdb4dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:47.769513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86c2e4-6aa9-4259-a5d9-ad2bdbdb4dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:47.836606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86c2e4-6aa9-4259-a5d9-ad2bdbdb4dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:47.838168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86c2e4-6aa9-4259-a5d9-ad2bdbdb4dfe None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:47.925984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:47.936397 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 644/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Thu Jun 2 13:05:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:05:47.942381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee07db9-28c4-4664-95ee-5e4290a1e1d0 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:48.001664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:48.038427 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee07db9-28c4-4664-95ee-5e4290a1e1d0 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:48.072015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef7d79-6275-4ea7-842a-0d849d384484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:48.072802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef7d79-6275-4ea7-842a-0d849d384484 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:48.073084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef7d79-6275-4ea7-842a-0d849d384484 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:48.073360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef7d79-6275-4ea7-842a-0d849d384484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:48.083131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef7d79-6275-4ea7-842a-0d849d384484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:48.084609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef7d79-6275-4ea7-842a-0d849d384484 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-c5ef7d79-6275-4ea7-842a-0d849d384484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:05:48.102288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:48.104198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:48.105939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:05:48.105939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:05:48.105939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:05:48.105939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:48.105939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 639/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:48.109480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86c2e4-6aa9-4259-a5d9-ad2bdbdb4dfe None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:48.206560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86c2e4-6aa9-4259-a5d9-ad2bdbdb4dfe None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:48.239223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86f174-e9b9-41f3-9408-cab6170a9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:48.239904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f174-e9b9-41f3-9408-cab6170a9c24 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:48.240182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f174-e9b9-41f3-9408-cab6170a9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:48.240449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f174-e9b9-41f3-9408-cab6170a9c24 None admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:48.241283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86f174-e9b9-41f3-9408-cab6170a9c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:48.241588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86f174-e9b9-41f3-9408-cab6170a9c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:48.242948 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86f174-e9b9-41f3-9408-cab6170a9c24 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:48.254084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 645/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Thu Jun 2 13:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:48.260366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef7d79-6275-4ea7-842a-0d849d384484 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:48.362744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef7d79-6275-4ea7-842a-0d849d384484 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:48.377951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:48.398162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0d2e4-fd24-42e0-8ca9-07fbde114dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:48.398961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0d2e4-fd24-42e0-8ca9-07fbde114dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:48.399240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0d2e4-fd24-42e0-8ca9-07fbde114dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:48.399508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0d2e4-fd24-42e0-8ca9-07fbde114dc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:48.406231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0d2e4-fd24-42e0-8ca9-07fbde114dc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:48.407715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0d2e4-fd24-42e0-8ca9-07fbde114dc4 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application [None req-82e0d2e4-fd24-42e0-8ca9-07fbde114dc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:05:48.422800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:48.424053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:48.425123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:05:48.425123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:05:48.425123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:05:48.425123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:05:48.425123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:05:48.425123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:05:48.425123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:05:48.425123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: ERROR keystone.server.flask.application Jun 02 13:05:48.425123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 640/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Thu Jun 2 13:05:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:48.430132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86f174-e9b9-41f3-9408-cab6170a9c24 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:48.482116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:48.534132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86f174-e9b9-41f3-9408-cab6170a9c24 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:48.570273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0175d-3e27-4302-9c55-121be4cb31fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:48.571088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0175d-3e27-4302-9c55-121be4cb31fc None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:48.571424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0175d-3e27-4302-9c55-121be4cb31fc None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:48.571804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0175d-3e27-4302-9c55-121be4cb31fc None admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:48.572705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0175d-3e27-4302-9c55-121be4cb31fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:48.573046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0175d-3e27-4302-9c55-121be4cb31fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:48.574715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0175d-3e27-4302-9c55-121be4cb31fc None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:48.587765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 646/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Thu Jun 2 13:05:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:48.593772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0d2e4-fd24-42e0-8ca9-07fbde114dc4 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:48.690249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0d2e4-fd24-42e0-8ca9-07fbde114dc4 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:48.722820 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35b876-dc6a-468d-a61a-87e1215200a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:48.723470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35b876-dc6a-468d-a61a-87e1215200a9 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:48.723750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35b876-dc6a-468d-a61a-87e1215200a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:48.724054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35b876-dc6a-468d-a61a-87e1215200a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:48.724921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35b876-dc6a-468d-a61a-87e1215200a9 None admin] RBAC: Adding query filter params (role.id=31c5600d1f984a04827cf0052fc61678, scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8, user.id=cc0624612b2a4b1683a638b7ce4ca0f1) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:48.725231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35b876-dc6a-468d-a61a-87e1215200a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:48.726742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35b876-dc6a-468d-a61a-87e1215200a9 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:48.732515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 641/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Thu Jun 2 13:05:48 2022] GET /identity/v3/role_assignments?user.id=cc0624612b2a4b1683a638b7ce4ca0f1&scope.project.id=ade2eaaff64b415f8aeafd96a4e7ada8&role.id=31c5600d1f984a04827cf0052fc61678 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:50.993010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7a52-b8fe-4c3f-b194-198f8ace8a8d None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:50.993544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7a52-b8fe-4c3f-b194-198f8ace8a8d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:50.993544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7a52-b8fe-4c3f-b194-198f8ace8a8d None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:50.994947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 647/1288] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:05:51.000411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e466-fbbe-4805-84c4-6235f0b3263b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:51.000839 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e466-fbbe-4805-84c4-6235f0b3263b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:51.000982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e466-fbbe-4805-84c4-6235f0b3263b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:51.019082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b4c9e466-fbbe-4805-84c4-6235f0b3263b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:51.020342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b4c9e466-fbbe-4805-84c4-6235f0b3263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:51.049741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:51.085580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 642/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:05:51.108454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7a52-b8fe-4c3f-b194-198f8ace8a8d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:51.215497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7a52-b8fe-4c3f-b194-198f8ace8a8d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:51.227339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:51.250374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c838c-d48c-412e-b87b-351c5c425f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:51.251098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c838c-d48c-412e-b87b-351c5c425f8e None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:51.251376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c838c-d48c-412e-b87b-351c5c425f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:51.251647 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c838c-d48c-412e-b87b-351c5c425f8e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:51.252340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c838c-d48c-412e-b87b-351c5c425f8e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:51.254073 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c838c-d48c-412e-b87b-351c5c425f8e None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-481c838c-d48c-412e-b87b-351c5c425f8e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:51.266462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:51.267767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:51.268775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 648/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Jun 2 13:05:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:51.273862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e466-fbbe-4805-84c4-6235f0b3263b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:51.370557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e466-fbbe-4805-84c4-6235f0b3263b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:51.404085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48977d-8d00-49ca-8ee0-fb8dc3220f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:51.404752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48977d-8d00-49ca-8ee0-fb8dc3220f92 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:51.405035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48977d-8d00-49ca-8ee0-fb8dc3220f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:51.405417 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48977d-8d00-49ca-8ee0-fb8dc3220f92 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:51.406126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48977d-8d00-49ca-8ee0-fb8dc3220f92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:51.406430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48977d-8d00-49ca-8ee0-fb8dc3220f92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:51.407788 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48977d-8d00-49ca-8ee0-fb8dc3220f92 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:51.413270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 643/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Jun 2 13:05:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:51.419359 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c838c-d48c-412e-b87b-351c5c425f8e None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:51.521554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c838c-d48c-412e-b87b-351c5c425f8e None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:51.556243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60727e3d-0a51-4a47-bea2-302a0acfe026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:51.556910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60727e3d-0a51-4a47-bea2-302a0acfe026 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:51.557195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60727e3d-0a51-4a47-bea2-302a0acfe026 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:51.557470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60727e3d-0a51-4a47-bea2-302a0acfe026 None admin] PATH_INFO: `/v3/services` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:51.558174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60727e3d-0a51-4a47-bea2-302a0acfe026 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:51.558477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60727e3d-0a51-4a47-bea2-302a0acfe026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:51.560007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60727e3d-0a51-4a47-bea2-302a0acfe026 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:51.564470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 649/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Jun 2 13:05:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:53.806570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1c669-60f4-464e-a6c1-add9958066c8 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:53.807103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1c669-60f4-464e-a6c1-add9958066c8 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:53.807103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1c669-60f4-464e-a6c1-add9958066c8 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:53.808453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 644/1293] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:05:53.813635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69745943-3cdc-498b-8e50-9c340761d5f2 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:53.814070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69745943-3cdc-498b-8e50-9c340761d5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:53.814174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69745943-3cdc-498b-8e50-9c340761d5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:53.831153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-69745943-3cdc-498b-8e50-9c340761d5f2 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:53.832355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-69745943-3cdc-498b-8e50-9c340761d5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:53.860716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:53.896459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 650/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:05:53.919593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1c669-60f4-464e-a6c1-add9958066c8 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:53.950226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:54.022398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1c669-60f4-464e-a6c1-add9958066c8 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:54.054674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e6eaf-47d1-400a-ad65-5f2f3de673e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:54.059052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6eaf-47d1-400a-ad65-5f2f3de673e6 None admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:54.059052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6eaf-47d1-400a-ad65-5f2f3de673e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:54.059052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6eaf-47d1-400a-ad65-5f2f3de673e6 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:54.059052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e6eaf-47d1-400a-ad65-5f2f3de673e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:54.059052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e6eaf-47d1-400a-ad65-5f2f3de673e6 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:54.145328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 645/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Thu Jun 2 13:05:53 2022] POST /identity/v3/services => generated 246 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:05:56.386214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd4929-df1c-4738-84bb-30c7207cbb2c None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:56.386757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd4929-df1c-4738-84bb-30c7207cbb2c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:56.386854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd4929-df1c-4738-84bb-30c7207cbb2c None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:56.388520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 651/1296] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:05:56.395419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849b07-d98c-49fb-a688-c383ebf5f1d4 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:56.396565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849b07-d98c-49fb-a688-c383ebf5f1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:56.396565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849b07-d98c-49fb-a688-c383ebf5f1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:56.413117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a1849b07-d98c-49fb-a688-c383ebf5f1d4 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:56.414294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a1849b07-d98c-49fb-a688-c383ebf5f1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:56.484447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 646/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:05:56.508550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd4929-df1c-4738-84bb-30c7207cbb2c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:56.608916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd4929-df1c-4738-84bb-30c7207cbb2c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:56.643183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b010c39-ad59-4903-910c-96a5fe64fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:56.643933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b010c39-ad59-4903-910c-96a5fe64fa94 None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:56.644216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b010c39-ad59-4903-910c-96a5fe64fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:56.644485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b010c39-ad59-4903-910c-96a5fe64fa94 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:56.645123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b010c39-ad59-4903-910c-96a5fe64fa94 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:56.646529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b010c39-ad59-4903-910c-96a5fe64fa94 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-1b010c39-ad59-4903-910c-96a5fe64fa94 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:56.658293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:56.659451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:56.660336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 652/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Jun 2 13:05:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:56.665565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1849b07-d98c-49fb-a688-c383ebf5f1d4 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:56.684059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:56.761065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1849b07-d98c-49fb-a688-c383ebf5f1d4 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:56.794063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648fe5a-1eac-4591-a19b-cc258f400448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:56.794714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648fe5a-1eac-4591-a19b-cc258f400448 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:56.794996 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648fe5a-1eac-4591-a19b-cc258f400448 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:56.795317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648fe5a-1eac-4591-a19b-cc258f400448 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:56.796054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648fe5a-1eac-4591-a19b-cc258f400448 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:56.796655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648fe5a-1eac-4591-a19b-cc258f400448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:56.798384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648fe5a-1eac-4591-a19b-cc258f400448 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:56.806060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 647/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Jun 2 13:05:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:56.813406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b010c39-ad59-4903-910c-96a5fe64fa94 None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:56.845252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:56.910917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b010c39-ad59-4903-910c-96a5fe64fa94 None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:56.943407 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4c999-93d3-4a2d-b9ed-95a7edddb60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:56.944075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4c999-93d3-4a2d-b9ed-95a7edddb60d None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:56.944356 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4c999-93d3-4a2d-b9ed-95a7edddb60d None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:56.944629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4c999-93d3-4a2d-b9ed-95a7edddb60d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:56.945405 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4c999-93d3-4a2d-b9ed-95a7edddb60d None admin] RBAC: Adding query filter params (interface=public, service_id=5441b1abb5a744d0b4317798ce6f9f32, region_id=RegionOne) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:56.945711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4c999-93d3-4a2d-b9ed-95a7edddb60d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:56.947062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4c999-93d3-4a2d-b9ed-95a7edddb60d None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:56.951881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 653/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Thu Jun 2 13:05:56 2022] GET /identity/v3/endpoints?service_id=5441b1abb5a744d0b4317798ce6f9f32&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:56.957394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648fe5a-1eac-4591-a19b-cc258f400448 None admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:57.039375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:57.056879 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648fe5a-1eac-4591-a19b-cc258f400448 None admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:57.089734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30802cc6-6329-4f9d-abd6-52c30aee06ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:57.090387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30802cc6-6329-4f9d-abd6-52c30aee06ea None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:57.090668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30802cc6-6329-4f9d-abd6-52c30aee06ea None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:57.090942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30802cc6-6329-4f9d-abd6-52c30aee06ea None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:57.091609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30802cc6-6329-4f9d-abd6-52c30aee06ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:57.093179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30802cc6-6329-4f9d-abd6-52c30aee06ea None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:57.100412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 648/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Thu Jun 2 13:05:56 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:05:59.335717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dba584-3fdb-4039-85ea-36279706fd52 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:59.336287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dba584-3fdb-4039-85ea-36279706fd52 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:59.336287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dba584-3fdb-4039-85ea-36279706fd52 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:59.337658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 654/1302] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:05:59.342773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91eeb3-811c-49b6-b7a1-3c4b399a42ed None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:59.343196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91eeb3-811c-49b6-b7a1-3c4b399a42ed None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:59.343330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91eeb3-811c-49b6-b7a1-3c4b399a42ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:59.361324 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0b91eeb3-811c-49b6-b7a1-3c4b399a42ed None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:05:59.362491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0b91eeb3-811c-49b6-b7a1-3c4b399a42ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:05:59.426334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 649/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:05:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:05:59.449401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dba584-3fdb-4039-85ea-36279706fd52 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:59.540727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:59.547904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dba584-3fdb-4039-85ea-36279706fd52 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:59.582229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d128-907f-4edf-b9ce-8893182aa2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:59.583034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d128-907f-4edf-b9ce-8893182aa2fd None admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:59.583324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d128-907f-4edf-b9ce-8893182aa2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:59.583601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d128-907f-4edf-b9ce-8893182aa2fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:59.584369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46d128-907f-4edf-b9ce-8893182aa2fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:59.585692 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46d128-907f-4edf-b9ce-8893182aa2fd None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application [None req-2d46d128-907f-4edf-b9ce-8893182aa2fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:05:59.597628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:05:59.598782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application with Lock( Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: ERROR keystone.server.flask.application Jun 02 13:05:59.599687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 655/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Thu Jun 2 13:05:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:05:59.604893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91eeb3-811c-49b6-b7a1-3c4b399a42ed None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:59.678368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:05:59.699719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91eeb3-811c-49b6-b7a1-3c4b399a42ed None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:59.731744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9218cb2-5742-4027-81ce-8e8ca32eb2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:59.732424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9218cb2-5742-4027-81ce-8e8ca32eb2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:59.732707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9218cb2-5742-4027-81ce-8e8ca32eb2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:59.732978 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9218cb2-5742-4027-81ce-8e8ca32eb2b8 None admin] PATH_INFO: `/v3/services` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:59.733665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9218cb2-5742-4027-81ce-8e8ca32eb2b8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:05:59.733967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9218cb2-5742-4027-81ce-8e8ca32eb2b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:59.735569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9218cb2-5742-4027-81ce-8e8ca32eb2b8 None admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:59.741045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 650/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Thu Jun 2 13:05:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:05:59.746820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d128-907f-4edf-b9ce-8893182aa2fd None admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:05:59.842874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d128-907f-4edf-b9ce-8893182aa2fd None admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:05:59.876724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911f93c-c962-44ca-a65b-76ed0556b1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:05:59.877366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911f93c-c962-44ca-a65b-76ed0556b1c2 None admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:05:59.877651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911f93c-c962-44ca-a65b-76ed0556b1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:05:59.877922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911f93c-c962-44ca-a65b-76ed0556b1c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:05:59.878663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911f93c-c962-44ca-a65b-76ed0556b1c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:05:59.880715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911f93c-c962-44ca-a65b-76ed0556b1c2 None admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:05:59.934454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 656/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Thu Jun 2 13:05:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:06:09.774292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=30 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:06:09.930063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:32.937305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba05c50-383c-4711-8d66-6d19f300e0e2 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:32.938004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba05c50-383c-4711-8d66-6d19f300e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:32.938295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba05c50-383c-4711-8d66-6d19f300e0e2 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:32.940004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 651/1307] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:11:32.945047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf199696-54d3-428f-ab3c-ca1d2cb780ef None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:32.945509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf199696-54d3-428f-ab3c-ca1d2cb780ef None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:32.945595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf199696-54d3-428f-ab3c-ca1d2cb780ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:33.030084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-cf199696-54d3-428f-ab3c-ca1d2cb780ef None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:11:33.031850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-cf199696-54d3-428f-ab3c-ca1d2cb780ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:33.222418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 657/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:11:33.268153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a8971-15a4-4b7d-9fbe-8352c4ec703a None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:33.268333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a8971-15a4-4b7d-9fbe-8352c4ec703a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:33.268572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a8971-15a4-4b7d-9fbe-8352c4ec703a None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:33.271186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 652/1309] 10.222.0.46 () {54 vars in 964 bytes} [Thu Jun 2 13:11:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:11:33.278832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d392c-6cb7-4dd1-8f8b-97ea782ca493 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:33.279158 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d392c-6cb7-4dd1-8f8b-97ea782ca493 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:33.279725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d392c-6cb7-4dd1-8f8b-97ea782ca493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:33.402718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-794d392c-6cb7-4dd1-8f8b-97ea782ca493 None None] MFA Rules not processed for user `ae7551e9626541d49a1be9330094f42e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:11:33.404059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-794d392c-6cb7-4dd1-8f8b-97ea782ca493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:33.428979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:33.493302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 658/1310] 10.222.0.46 () {58 vars in 1061 bytes} [Thu Jun 2 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:11:33.502424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a8971-15a4-4b7d-9fbe-8352c4ec703a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:11:33.504400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-241a8971-15a4-4b7d-9fbe-8352c4ec703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:33.626335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a8971-15a4-4b7d-9fbe-8352c4ec703a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:11:33.704217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39820ad1-bb95-42fd-a6cb-5edee0ad5a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:11:33.704870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39820ad1-bb95-42fd-a6cb-5edee0ad5a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:33.705147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39820ad1-bb95-42fd-a6cb-5edee0ad5a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:33.705418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39820ad1-bb95-42fd-a6cb-5edee0ad5a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:33.707059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-39820ad1-bb95-42fd-a6cb-5edee0ad5a82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:33.765210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:33.822461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39820ad1-bb95-42fd-a6cb-5edee0ad5a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:11:33.823924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39820ad1-bb95-42fd-a6cb-5edee0ad5a82 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:11:33.843425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 653/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:11:36.447281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c7a9-4a22-484e-9914-0f080d5c317d None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:36.447710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c7a9-4a22-484e-9914-0f080d5c317d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:36.447998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118c7a9-4a22-484e-9914-0f080d5c317d None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:36.455261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24724804-bd6f-4d56-8dc2-6adeaf5028dd None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:36.455725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24724804-bd6f-4d56-8dc2-6adeaf5028dd None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:36.455947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24724804-bd6f-4d56-8dc2-6adeaf5028dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:36.459801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 659/1312] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:11:36 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:11:36.545291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-24724804-bd6f-4d56-8dc2-6adeaf5028dd None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:11:36.546503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-24724804-bd6f-4d56-8dc2-6adeaf5028dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:36.648981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 654/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:11:36.690728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118c7a9-4a22-484e-9914-0f080d5c317d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:11:36.692506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a118c7a9-4a22-484e-9914-0f080d5c317d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:36.803720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118c7a9-4a22-484e-9914-0f080d5c317d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:11:36.880466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:36.884126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a4d88-0f35-43c5-a43b-6057d0b535b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:11:36.884774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a4d88-0f35-43c5-a43b-6057d0b535b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:36.885049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a4d88-0f35-43c5-a43b-6057d0b535b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:36.885318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a4d88-0f35-43c5-a43b-6057d0b535b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:36.887042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-aa6a4d88-0f35-43c5-a43b-6057d0b535b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:37.006293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a4d88-0f35-43c5-a43b-6057d0b535b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:11:37.007933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a4d88-0f35-43c5-a43b-6057d0b535b1 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:11:37.027680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 660/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:11:39.861970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70437f6-a1f8-4dba-9b56-feffa45374aa None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:39.862538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70437f6-a1f8-4dba-9b56-feffa45374aa None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:39.862538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70437f6-a1f8-4dba-9b56-feffa45374aa None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:39.863897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 655/1315] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:11:39.869506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c0a67-efeb-4abf-a22c-119143239626 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:39.869890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c0a67-efeb-4abf-a22c-119143239626 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:39.870053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c0a67-efeb-4abf-a22c-119143239626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:39.933043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a87c0a67-efeb-4abf-a22c-119143239626 None None] MFA Rules not processed for user `4d880a26c97040af9607efb3a077fe5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:11:39.934168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a87c0a67-efeb-4abf-a22c-119143239626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:39.984398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:40.030212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 661/1316] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:11:40.069944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70437f6-a1f8-4dba-9b56-feffa45374aa None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:11:40.071531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d70437f6-a1f8-4dba-9b56-feffa45374aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:40.081636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:40.172266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70437f6-a1f8-4dba-9b56-feffa45374aa None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:11:40.247508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc26ba-738f-4b08-a85a-366b0cc198ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:11:40.248189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc26ba-738f-4b08-a85a-366b0cc198ac service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:40.248517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc26ba-738f-4b08-a85a-366b0cc198ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:40.248844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc26ba-738f-4b08-a85a-366b0cc198ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:40.250782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b2cc26ba-738f-4b08-a85a-366b0cc198ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:40.312750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:40.359151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc26ba-738f-4b08-a85a-366b0cc198ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:11:40.360757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc26ba-738f-4b08-a85a-366b0cc198ac service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:11:40.378173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 656/1317] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:11:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:11:43.339652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b753ff2-8fc5-447d-a9ad-cf7d61779385 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:43.340204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b753ff2-8fc5-447d-a9ad-cf7d61779385 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:43.340323 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b753ff2-8fc5-447d-a9ad-cf7d61779385 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:43.341625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 662/1318] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:11:43.349962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a5913-2e07-4a0c-9e7e-08e99876bafb None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:43.350408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a5913-2e07-4a0c-9e7e-08e99876bafb None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:43.350529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a5913-2e07-4a0c-9e7e-08e99876bafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:43.414492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-360a5913-2e07-4a0c-9e7e-08e99876bafb None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:11:43.415638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-360a5913-2e07-4a0c-9e7e-08e99876bafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:43.508975 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 657/1319] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:11:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:11:43.547010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b753ff2-8fc5-447d-a9ad-cf7d61779385 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:11:43.548582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6b753ff2-8fc5-447d-a9ad-cf7d61779385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:43.650733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b753ff2-8fc5-447d-a9ad-cf7d61779385 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:11:43.720984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a399808-2142-4058-945f-a04cb6fc8c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:11:43.721554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a399808-2142-4058-945f-a04cb6fc8c72 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:43.721837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a399808-2142-4058-945f-a04cb6fc8c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:43.722102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a399808-2142-4058-945f-a04cb6fc8c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:43.723716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8a399808-2142-4058-945f-a04cb6fc8c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:43.732895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:43.831019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a399808-2142-4058-945f-a04cb6fc8c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:11:43.832480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a399808-2142-4058-945f-a04cb6fc8c72 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:11:43.849775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 663/1320] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:11:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:11:47.217915 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42893232-c63b-471c-98ca-163a9b5b1bd4 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:47.218451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42893232-c63b-471c-98ca-163a9b5b1bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:47.218545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42893232-c63b-471c-98ca-163a9b5b1bd4 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:47.219859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 658/1321] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:11:47.225325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3acb60-61a7-4289-9234-7715a854a79b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:47.225736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3acb60-61a7-4289-9234-7715a854a79b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:47.225885 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3acb60-61a7-4289-9234-7715a854a79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:47.290344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-df3acb60-61a7-4289-9234-7715a854a79b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:11:47.291684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-df3acb60-61a7-4289-9234-7715a854a79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:47.349601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:47.392565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 664/1322] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:11:47.427925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42893232-c63b-471c-98ca-163a9b5b1bd4 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:11:47.429558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-42893232-c63b-471c-98ca-163a9b5b1bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:47.449694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:47.532969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42893232-c63b-471c-98ca-163a9b5b1bd4 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:11:47.604870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba251de-e9e9-4a46-a41f-a675e1ba4b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:11:47.605520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba251de-e9e9-4a46-a41f-a675e1ba4b66 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:47.606060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba251de-e9e9-4a46-a41f-a675e1ba4b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:47.606340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba251de-e9e9-4a46-a41f-a675e1ba4b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:47.608010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1ba251de-e9e9-4a46-a41f-a675e1ba4b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:47.677994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:47.717623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba251de-e9e9-4a46-a41f-a675e1ba4b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:11:47.719058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba251de-e9e9-4a46-a41f-a675e1ba4b66 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:11:47.741574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 659/1323] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:11:50.058643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beba78-fe17-4155-b10b-29f2e98b1f75 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:50.059192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beba78-fe17-4155-b10b-29f2e98b1f75 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:50.059192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beba78-fe17-4155-b10b-29f2e98b1f75 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:50.060539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 665/1324] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:11:50.065973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121022a-aa2a-4024-a9a5-427edb40e198 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:50.066371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121022a-aa2a-4024-a9a5-427edb40e198 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:50.066529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121022a-aa2a-4024-a9a5-427edb40e198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:50.134592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a121022a-aa2a-4024-a9a5-427edb40e198 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:11:50.135813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a121022a-aa2a-4024-a9a5-427edb40e198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:50.232147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 660/1325] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:11:50.268799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0beba78-fe17-4155-b10b-29f2e98b1f75 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:11:50.270340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e0beba78-fe17-4155-b10b-29f2e98b1f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:50.373121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0beba78-fe17-4155-b10b-29f2e98b1f75 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:11:50.447195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdaa2-52ba-47fd-979f-23f4743d2d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:11:50.447939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdaa2-52ba-47fd-979f-23f4743d2d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:50.448167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdaa2-52ba-47fd-979f-23f4743d2d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:50.448449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdaa2-52ba-47fd-979f-23f4743d2d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:50.450112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a4abdaa2-52ba-47fd-979f-23f4743d2d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:50.468116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:50.562383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdaa2-52ba-47fd-979f-23f4743d2d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:11:50.563859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdaa2-52ba-47fd-979f-23f4743d2d65 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:11:50.583187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 666/1326] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:11:52.917280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a4160-02e1-423b-aa59-2f8af87bf48e None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:52.917811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a4160-02e1-423b-aa59-2f8af87bf48e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:52.917943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a4160-02e1-423b-aa59-2f8af87bf48e None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:52.919514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 661/1327] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:11:52.926315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d57dc-45db-41f7-8b35-3bed60ff97de None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:52.926728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d57dc-45db-41f7-8b35-3bed60ff97de None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:52.927049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d57dc-45db-41f7-8b35-3bed60ff97de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:52.994704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-2e8d57dc-45db-41f7-8b35-3bed60ff97de None None] MFA Rules not processed for user `4d880a26c97040af9607efb3a077fe5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:11:52.995942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2e8d57dc-45db-41f7-8b35-3bed60ff97de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:53.065436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:53.097708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 667/1328] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:11:53.142675 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a4160-02e1-423b-aa59-2f8af87bf48e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:11:53.144252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fe6a4160-02e1-423b-aa59-2f8af87bf48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:53.178523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:53.257100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a4160-02e1-423b-aa59-2f8af87bf48e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:11:53.328709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d094c-7499-4adb-8d4f-217edef08c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:11:53.329363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d094c-7499-4adb-8d4f-217edef08c0f service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:53.329647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d094c-7499-4adb-8d4f-217edef08c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:53.329922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d094c-7499-4adb-8d4f-217edef08c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:53.331557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c00d094c-7499-4adb-8d4f-217edef08c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:53.412243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:53.447616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d094c-7499-4adb-8d4f-217edef08c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:11:53.449150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d094c-7499-4adb-8d4f-217edef08c0f service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:11:53.469202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 662/1329] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:11:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:11:56.180380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5cb20-2b6a-4a8c-90be-c3395245dd05 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:56.180903 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5cb20-2b6a-4a8c-90be-c3395245dd05 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:56.180999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5cb20-2b6a-4a8c-90be-c3395245dd05 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:56.182355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 668/1330] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:11:56.187948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4b7b4-ec56-4af8-91a7-973a2a3a03ae None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:56.188450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4b7b4-ec56-4af8-91a7-973a2a3a03ae None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:56.188567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4b7b4-ec56-4af8-91a7-973a2a3a03ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:56.253846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0cc4b7b4-ec56-4af8-91a7-973a2a3a03ae None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:11:56.255029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0cc4b7b4-ec56-4af8-91a7-973a2a3a03ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:56.483559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 663/1331] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:11:56.519227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5cb20-2b6a-4a8c-90be-c3395245dd05 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:11:56.520872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4be5cb20-2b6a-4a8c-90be-c3395245dd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:56.628372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5cb20-2b6a-4a8c-90be-c3395245dd05 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:11:56.704912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47a7c4-8546-4da4-8e2c-4f007818231c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:11:56.705570 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47a7c4-8546-4da4-8e2c-4f007818231c service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:56.705851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47a7c4-8546-4da4-8e2c-4f007818231c service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:56.706126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47a7c4-8546-4da4-8e2c-4f007818231c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:56.707778 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-dd47a7c4-8546-4da4-8e2c-4f007818231c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:56.737118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:56.824552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47a7c4-8546-4da4-8e2c-4f007818231c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:11:56.826022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47a7c4-8546-4da4-8e2c-4f007818231c service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:11:56.845598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 669/1332] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:11:59.149851 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea482e-fa67-477d-b1c8-6a38783b8c45 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:59.150386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea482e-fa67-477d-b1c8-6a38783b8c45 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:59.150386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea482e-fa67-477d-b1c8-6a38783b8c45 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:59.151755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 664/1333] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:11:59.157039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc9ab-e918-47bb-be8f-25dfd95ae0df None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:59.157408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc9ab-e918-47bb-be8f-25dfd95ae0df None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:59.157606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc9ab-e918-47bb-be8f-25dfd95ae0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:59.226973 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0e9cc9ab-e918-47bb-be8f-25dfd95ae0df None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:11:59.228217 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0e9cc9ab-e918-47bb-be8f-25dfd95ae0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:59.302211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:59.324633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 670/1334] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:11:59.364091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea482e-fa67-477d-b1c8-6a38783b8c45 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:11:59.365614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0cea482e-fa67-477d-b1c8-6a38783b8c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:59.406558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:59.468492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea482e-fa67-477d-b1c8-6a38783b8c45 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:11:59.541030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac68573-68c3-4ab5-919b-76104080b611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:11:59.541700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68573-68c3-4ab5-919b-76104080b611 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:11:59.541975 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68573-68c3-4ab5-919b-76104080b611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:11:59.542244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68573-68c3-4ab5-919b-76104080b611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:11:59.543860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6ac68573-68c3-4ab5-919b-76104080b611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:11:59.633263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:11:59.658142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac68573-68c3-4ab5-919b-76104080b611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:11:59.659495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac68573-68c3-4ab5-919b-76104080b611 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:11:59.677567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 665/1335] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:02.512099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433db130-87c8-450d-a6a8-e6457a14ac12 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:02.512630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433db130-87c8-450d-a6a8-e6457a14ac12 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:02.512725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433db130-87c8-450d-a6a8-e6457a14ac12 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:02.514106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 671/1336] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:02.519361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0ff38-e942-4ac3-abde-90c9d266e52d None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:02.519768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0ff38-e942-4ac3-abde-90c9d266e52d None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:02.519946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0ff38-e942-4ac3-abde-90c9d266e52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:02.582604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d0d0ff38-e942-4ac3-abde-90c9d266e52d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:02.583803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d0d0ff38-e942-4ac3-abde-90c9d266e52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:02.677392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 666/1337] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:02.713252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433db130-87c8-450d-a6a8-e6457a14ac12 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:02.714779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-433db130-87c8-450d-a6a8-e6457a14ac12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:02.816489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433db130-87c8-450d-a6a8-e6457a14ac12 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:02.886977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71df1d-fef8-4be6-9074-e7bda9153d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:02.887619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71df1d-fef8-4be6-9074-e7bda9153d5e service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:02.887926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71df1d-fef8-4be6-9074-e7bda9153d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:02.888207 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71df1d-fef8-4be6-9074-e7bda9153d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:02.889837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ba71df1d-fef8-4be6-9074-e7bda9153d5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:02.924599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:02.998846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71df1d-fef8-4be6-9074-e7bda9153d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:03.000251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71df1d-fef8-4be6-9074-e7bda9153d5e service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:03.018312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 672/1338] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:07.560399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad810e-5408-4ca2-bbb8-664cd82be993 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:07.560950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad810e-5408-4ca2-bbb8-664cd82be993 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:07.560950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad810e-5408-4ca2-bbb8-664cd82be993 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:07.562329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 667/1339] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:07.568036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458805-a02c-4413-a1bf-7bc552321da3 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:07.568468 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458805-a02c-4413-a1bf-7bc552321da3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:07.568618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458805-a02c-4413-a1bf-7bc552321da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:07.649150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7d458805-a02c-4413-a1bf-7bc552321da3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:07.650350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7d458805-a02c-4413-a1bf-7bc552321da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:07.744454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:07.757958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 673/1340] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:12:07.796995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad810e-5408-4ca2-bbb8-664cd82be993 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:07.799106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-84ad810e-5408-4ca2-bbb8-664cd82be993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:07.847684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:07.893761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad810e-5408-4ca2-bbb8-664cd82be993 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:07.897324 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9dc1e-0980-4279-8753-3bfc4e4dddaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:07.898001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9dc1e-0980-4279-8753-3bfc4e4dddaa service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:07.898288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9dc1e-0980-4279-8753-3bfc4e4dddaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:07.898568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9dc1e-0980-4279-8753-3bfc4e4dddaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:07.907802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9dc1e-0980-4279-8753-3bfc4e4dddaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:07.909323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9dc1e-0980-4279-8753-3bfc4e4dddaa service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:07.919897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 668/1341] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:11.127382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0a202-6d6a-456b-ad3f-421388b52fc6 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:11.127946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0a202-6d6a-456b-ad3f-421388b52fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:11.128041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0a202-6d6a-456b-ad3f-421388b52fc6 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:11.129378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 674/1342] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:11.134845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22049-c116-4d2e-92b6-7a0327892b7f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:11.135265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22049-c116-4d2e-92b6-7a0327892b7f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:11.135480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22049-c116-4d2e-92b6-7a0327892b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:11.163169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b6d22049-c116-4d2e-92b6-7a0327892b7f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:11.164943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b6d22049-c116-4d2e-92b6-7a0327892b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:11.243578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 669/1343] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:11.281313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0a202-6d6a-456b-ad3f-421388b52fc6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:11.292706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0a202-6d6a-456b-ad3f-421388b52fc6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:11.296221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9846eb2-9e85-4873-b47c-6913d28f1a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:11.296867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9846eb2-9e85-4873-b47c-6913d28f1a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:11.297153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9846eb2-9e85-4873-b47c-6913d28f1a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:11.297430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9846eb2-9e85-4873-b47c-6913d28f1a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:11.306501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9846eb2-9e85-4873-b47c-6913d28f1a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:11.307969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9846eb2-9e85-4873-b47c-6913d28f1a82 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:11.318110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 675/1344] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:15.716488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54bd35-0862-4904-9125-819187f0e400 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:15.717025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54bd35-0862-4904-9125-819187f0e400 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:15.717025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54bd35-0862-4904-9125-819187f0e400 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:15.718433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 670/1345] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:15.723695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d986a12-8b2a-489f-8f47-170c6546403c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:15.724138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d986a12-8b2a-489f-8f47-170c6546403c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:15.724311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d986a12-8b2a-489f-8f47-170c6546403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:15.742783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4d986a12-8b2a-489f-8f47-170c6546403c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:15.744001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4d986a12-8b2a-489f-8f47-170c6546403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:15.754670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 676/1346] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:12:15.792661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54bd35-0862-4904-9125-819187f0e400 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:15.803462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54bd35-0862-4904-9125-819187f0e400 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:15.807643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b7fbb-5162-4073-b77f-0149ec88aa98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:15.808335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7fbb-5162-4073-b77f-0149ec88aa98 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:15.808621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7fbb-5162-4073-b77f-0149ec88aa98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:15.808895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b7fbb-5162-4073-b77f-0149ec88aa98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:15.817895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b7fbb-5162-4073-b77f-0149ec88aa98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:15.819340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b7fbb-5162-4073-b77f-0149ec88aa98 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:15.829457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 671/1347] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:21.216031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82785-31ff-458f-b752-5c21ce251d1a None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:21.217648 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82785-31ff-458f-b752-5c21ce251d1a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:21.218213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82785-31ff-458f-b752-5c21ce251d1a None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:21.220565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 677/1348] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:12:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:21.227285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb75015-4e4e-45dc-9873-67f5d491e64f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:21.227741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb75015-4e4e-45dc-9873-67f5d491e64f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:21.227849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb75015-4e4e-45dc-9873-67f5d491e64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:21.303526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-6cb75015-4e4e-45dc-9873-67f5d491e64f None None] MFA Rules not processed for user `cc0624612b2a4b1683a638b7ce4ca0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:21.305509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6cb75015-4e4e-45dc-9873-67f5d491e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:21.377373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:21.495512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 672/1349] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:25.737663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=13 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:25.967756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1788-d13d-492f-b8b4-d398fd5bcb9a None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:25.968664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1788-d13d-492f-b8b4-d398fd5bcb9a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:25.969641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1788-d13d-492f-b8b4-d398fd5bcb9a None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:25.972251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 678/1350] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:12:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:25.980116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4581ef3-ea95-4873-941e-8f9d591e7520 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:25.983081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4581ef3-ea95-4873-941e-8f9d591e7520 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:25.983081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4581ef3-ea95-4873-941e-8f9d591e7520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:26.003719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f4581ef3-ea95-4873-941e-8f9d591e7520 None None] MFA Rules not processed for user `cc0624612b2a4b1683a638b7ce4ca0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:26.005493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f4581ef3-ea95-4873-941e-8f9d591e7520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:26.016565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 673/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:27.630891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9baaa-d9e0-4a9c-9786-1b2a8970a122 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:27.631491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9baaa-d9e0-4a9c-9786-1b2a8970a122 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:27.631822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9baaa-d9e0-4a9c-9786-1b2a8970a122 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:27.633706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 679/1352] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:27.639992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcf900-4cf4-404f-b6fa-92264dc4b1eb None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:27.640728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcf900-4cf4-404f-b6fa-92264dc4b1eb None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:27.640976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcf900-4cf4-404f-b6fa-92264dc4b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:27.660727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b4dcf900-4cf4-404f-b6fa-92264dc4b1eb None None] MFA Rules not processed for user `cc0624612b2a4b1683a638b7ce4ca0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:27.661964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b4dcf900-4cf4-404f-b6fa-92264dc4b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:27.672143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 674/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:31.452826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e08314-e691-4eb5-b3c2-244e9e5a64e4 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:31.453591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e08314-e691-4eb5-b3c2-244e9e5a64e4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:31.453591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e08314-e691-4eb5-b3c2-244e9e5a64e4 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:31.457570 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 680/1354] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:31.461558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb91c7f-d0ff-4847-ad31-43d863dd7e72 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:31.462496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb91c7f-d0ff-4847-ad31-43d863dd7e72 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:31.463020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb91c7f-d0ff-4847-ad31-43d863dd7e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:31.483143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9fb91c7f-d0ff-4847-ad31-43d863dd7e72 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:31.484479 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9fb91c7f-d0ff-4847-ad31-43d863dd7e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:31.495093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 675/1355] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:31.565454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3a6ea-ce77-46c8-87a4-8ff2644f05f9 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:31.565744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3a6ea-ce77-46c8-87a4-8ff2644f05f9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:31.566258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3a6ea-ce77-46c8-87a4-8ff2644f05f9 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:31.567838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 681/1356] 10.222.0.46 () {54 vars in 961 bytes} [Thu Jun 2 13:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:12:31.580814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2d0af-ebfd-4a76-bd1b-0b362dd484c7 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:31.581614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2d0af-ebfd-4a76-bd1b-0b362dd484c7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:31.582085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2d0af-ebfd-4a76-bd1b-0b362dd484c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:31.668132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f0c2d0af-ebfd-4a76-bd1b-0b362dd484c7 None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:31.669963 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f0c2d0af-ebfd-4a76-bd1b-0b362dd484c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:31.816383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 676/1357] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Jun 2 13:12:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:31.826717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3a6ea-ce77-46c8-87a4-8ff2644f05f9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:31.845515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3a6ea-ce77-46c8-87a4-8ff2644f05f9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:31.852805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821bdfe-34d7-42db-b9e6-4ee89b3b28ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:31.853790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821bdfe-34d7-42db-b9e6-4ee89b3b28ea service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:31.854266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821bdfe-34d7-42db-b9e6-4ee89b3b28ea service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:31.855057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821bdfe-34d7-42db-b9e6-4ee89b3b28ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:31.865688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821bdfe-34d7-42db-b9e6-4ee89b3b28ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:31.867686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821bdfe-34d7-42db-b9e6-4ee89b3b28ea service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:31.880677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 682/1358] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:34.546586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192feb-b08f-4c26-a534-be32b5b45f27 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:34.547141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192feb-b08f-4c26-a534-be32b5b45f27 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:34.547141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192feb-b08f-4c26-a534-be32b5b45f27 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:34.548734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 677/1359] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:34.554582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c861f-027d-4d2b-9ee5-41acf030e37d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:34.555091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c861f-027d-4d2b-9ee5-41acf030e37d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:34.555191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c861f-027d-4d2b-9ee5-41acf030e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:34.573403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a53c861f-027d-4d2b-9ee5-41acf030e37d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:34.574600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a53c861f-027d-4d2b-9ee5-41acf030e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:34.582766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 683/1360] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:34.628138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192feb-b08f-4c26-a534-be32b5b45f27 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:34.644049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192feb-b08f-4c26-a534-be32b5b45f27 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:34.649910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42de04b-ac65-499c-87e1-9887e3bd90ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:34.650847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de04b-ac65-499c-87e1-9887e3bd90ab service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:34.651142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de04b-ac65-499c-87e1-9887e3bd90ab service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:34.651487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de04b-ac65-499c-87e1-9887e3bd90ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:34.661489 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42de04b-ac65-499c-87e1-9887e3bd90ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:34.663277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42de04b-ac65-499c-87e1-9887e3bd90ab service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:34.675113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 678/1361] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:37.397414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002472a2-62f2-4f33-a91d-e69b4a801c90 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:37.397956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002472a2-62f2-4f33-a91d-e69b4a801c90 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:37.397956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002472a2-62f2-4f33-a91d-e69b4a801c90 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:37.402732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 684/1362] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:37.405222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e8de-2be9-45e2-a361-1e22432525e7 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:37.405982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e8de-2be9-45e2-a361-1e22432525e7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:37.406417 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e8de-2be9-45e2-a361-1e22432525e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:37.431406 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-2698e8de-2be9-45e2-a361-1e22432525e7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:37.432997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2698e8de-2be9-45e2-a361-1e22432525e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:37.443788 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 679/1363] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:37.490097 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187df7f-cb27-4de7-aa77-396b5a3b926d None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:37.490452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187df7f-cb27-4de7-aa77-396b5a3b926d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:37.490746 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187df7f-cb27-4de7-aa77-396b5a3b926d None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:37.492168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 685/1364] 10.222.0.46 () {54 vars in 961 bytes} [Thu Jun 2 13:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:37.497513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033600-d507-4004-9f13-f39d7d7cc772 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:37.497802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033600-d507-4004-9f13-f39d7d7cc772 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:37.498078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033600-d507-4004-9f13-f39d7d7cc772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:37.515947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-1a033600-d507-4004-9f13-f39d7d7cc772 None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:37.517071 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1a033600-d507-4004-9f13-f39d7d7cc772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:37.526712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 680/1365] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Jun 2 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:37.534417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187df7f-cb27-4de7-aa77-396b5a3b926d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:37.549122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187df7f-cb27-4de7-aa77-396b5a3b926d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:37.554553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3fa1e-8bfe-4dd3-bd7d-42dfbbde7cc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:37.555190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3fa1e-8bfe-4dd3-bd7d-42dfbbde7cc5 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:37.555473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3fa1e-8bfe-4dd3-bd7d-42dfbbde7cc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:37.555747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3fa1e-8bfe-4dd3-bd7d-42dfbbde7cc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:37.563789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3fa1e-8bfe-4dd3-bd7d-42dfbbde7cc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:37.565403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3fa1e-8bfe-4dd3-bd7d-42dfbbde7cc5 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:37.574896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 686/1366] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:40.029085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde30e-836c-4e52-a189-6fdf65dd763e None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:40.029728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde30e-836c-4e52-a189-6fdf65dd763e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:40.029728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde30e-836c-4e52-a189-6fdf65dd763e None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:40.031008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 681/1367] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:40.036422 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca517b2-48c6-4d20-b779-37488cea2309 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:40.036851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca517b2-48c6-4d20-b779-37488cea2309 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:40.037010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca517b2-48c6-4d20-b779-37488cea2309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:40.055956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4ca517b2-48c6-4d20-b779-37488cea2309 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:40.057164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4ca517b2-48c6-4d20-b779-37488cea2309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:40.065388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 687/1368] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:40.115136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bde30e-836c-4e52-a189-6fdf65dd763e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:40.130361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bde30e-836c-4e52-a189-6fdf65dd763e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:40.136588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76343738-2a31-4662-aa48-70d7e664fad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:40.137271 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76343738-2a31-4662-aa48-70d7e664fad6 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:40.137557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76343738-2a31-4662-aa48-70d7e664fad6 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:40.137836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76343738-2a31-4662-aa48-70d7e664fad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:40.148069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76343738-2a31-4662-aa48-70d7e664fad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:40.149705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76343738-2a31-4662-aa48-70d7e664fad6 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:40.160243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 682/1369] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:40.216221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe65f2-27fc-488d-be31-c63f737380ae None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:40.216617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe65f2-27fc-488d-be31-c63f737380ae None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:40.216976 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe65f2-27fc-488d-be31-c63f737380ae None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:40.218504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 688/1370] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:40.224077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e932f-e4eb-48b1-b23c-4c8aed5a032a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:40.224376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e932f-e4eb-48b1-b23c-4c8aed5a032a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:40.224665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e932f-e4eb-48b1-b23c-4c8aed5a032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:40.244317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-be3e932f-e4eb-48b1-b23c-4c8aed5a032a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:40.247360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-be3e932f-e4eb-48b1-b23c-4c8aed5a032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:40.254461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 683/1371] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:40.536354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363912-3a79-4e9f-9843-a9a91717d787 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:40.536562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363912-3a79-4e9f-9843-a9a91717d787 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:40.537033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363912-3a79-4e9f-9843-a9a91717d787 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:40.538954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 689/1372] 10.222.0.46 () {54 vars in 963 bytes} [Thu Jun 2 13:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:40.544637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff475-2825-4019-8c20-9f88cbbae924 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:40.545101 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff475-2825-4019-8c20-9f88cbbae924 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:40.545535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff475-2825-4019-8c20-9f88cbbae924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:40.555000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:40.601218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b35ff475-2825-4019-8c20-9f88cbbae924 None None] MFA Rules not processed for user `c2bc11c0ef524d7ea5cb8704fbbfcbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:40.602717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b35ff475-2825-4019-8c20-9f88cbbae924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:40.670503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 684/1373] 10.222.0.46 () {58 vars in 1060 bytes} [Thu Jun 2 13:12:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:40.678954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363912-3a79-4e9f-9843-a9a91717d787 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:40.690004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363912-3a79-4e9f-9843-a9a91717d787 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:40.694258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4848e-e5fb-4e52-a8e4-eba4f7cf4dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:40.694911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4848e-e5fb-4e52-a8e4-eba4f7cf4dae service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:40.695195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4848e-e5fb-4e52-a8e4-eba4f7cf4dae service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:40.695473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4848e-e5fb-4e52-a8e4-eba4f7cf4dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:40.705031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4848e-e5fb-4e52-a8e4-eba4f7cf4dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:40.706476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4848e-e5fb-4e52-a8e4-eba4f7cf4dae service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:40.716717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 690/1374] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:42.624503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de596266-1619-43f9-beb1-2340a61392a9 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:42.625094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de596266-1619-43f9-beb1-2340a61392a9 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:42.625094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de596266-1619-43f9-beb1-2340a61392a9 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:42.626472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 685/1375] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:42.632416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4fef6-4f10-418f-b034-0eda008f99f5 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:42.632962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4fef6-4f10-418f-b034-0eda008f99f5 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:42.632962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4fef6-4f10-418f-b034-0eda008f99f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:42.652633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3ea4fef6-4f10-418f-b034-0eda008f99f5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:42.653862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3ea4fef6-4f10-418f-b034-0eda008f99f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:42.661913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 691/1376] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:42.709500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de596266-1619-43f9-beb1-2340a61392a9 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:42.724290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de596266-1619-43f9-beb1-2340a61392a9 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:42.731062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21dfb5-97df-4536-81c2-f10d2aa56e1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:42.731733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21dfb5-97df-4536-81c2-f10d2aa56e1e service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:42.732054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21dfb5-97df-4536-81c2-f10d2aa56e1e service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:42.732340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21dfb5-97df-4536-81c2-f10d2aa56e1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:42.741689 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21dfb5-97df-4536-81c2-f10d2aa56e1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:42.743312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21dfb5-97df-4536-81c2-f10d2aa56e1e service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:42.754117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 686/1377] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:12:45.157800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae165-0e07-4989-83f2-62b5a0d4d51c None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:45.158711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae165-0e07-4989-83f2-62b5a0d4d51c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:45.158993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cae165-0e07-4989-83f2-62b5a0d4d51c None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:45.161241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 692/1378] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:45.165939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bc42c-c199-4f68-9b69-acae6614e271 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:45.166381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bc42c-c199-4f68-9b69-acae6614e271 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:45.166487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bc42c-c199-4f68-9b69-acae6614e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:45.185101 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-753bc42c-c199-4f68-9b69-acae6614e271 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:45.186276 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-753bc42c-c199-4f68-9b69-acae6614e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:45.195344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 687/1379] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:45.239281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cae165-0e07-4989-83f2-62b5a0d4d51c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:45.255608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cae165-0e07-4989-83f2-62b5a0d4d51c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:45.261368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2447d-59ae-43dd-b62a-8f5f365606f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:45.262103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2447d-59ae-43dd-b62a-8f5f365606f3 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:45.262485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2447d-59ae-43dd-b62a-8f5f365606f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:45.262840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2447d-59ae-43dd-b62a-8f5f365606f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:45.271437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2447d-59ae-43dd-b62a-8f5f365606f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:45.273075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2447d-59ae-43dd-b62a-8f5f365606f3 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:45.282947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 693/1380] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:47.714431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f9d8-9413-4a36-9d0d-4d8aa9a4ef95 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:47.714947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f9d8-9413-4a36-9d0d-4d8aa9a4ef95 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:47.714947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f9d8-9413-4a36-9d0d-4d8aa9a4ef95 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:47.716301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 688/1381] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:47.721640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f02e-39ae-4088-acac-aa934094022b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:47.722049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f02e-39ae-4088-acac-aa934094022b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:47.722256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f02e-39ae-4088-acac-aa934094022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:47.740188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3312f02e-39ae-4088-acac-aa934094022b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:47.741372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3312f02e-39ae-4088-acac-aa934094022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:47.749434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 694/1382] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:47.792255 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194f9d8-9413-4a36-9d0d-4d8aa9a4ef95 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:47.806802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194f9d8-9413-4a36-9d0d-4d8aa9a4ef95 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:47.812938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c341754-9228-4983-98c2-77d0b7ffcbc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:47.813581 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c341754-9228-4983-98c2-77d0b7ffcbc4 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:47.813862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c341754-9228-4983-98c2-77d0b7ffcbc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:47.814144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c341754-9228-4983-98c2-77d0b7ffcbc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:47.822881 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c341754-9228-4983-98c2-77d0b7ffcbc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:47.824481 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c341754-9228-4983-98c2-77d0b7ffcbc4 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:47.835714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 689/1383] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:50.131742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e5c8-1aa6-4c62-a716-e1c33c5fc56c None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:50.132329 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e5c8-1aa6-4c62-a716-e1c33c5fc56c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:50.132627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e5c8-1aa6-4c62-a716-e1c33c5fc56c None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:50.134368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 695/1384] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:50.139841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764536d4-5711-4d0c-b822-721a130aff82 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:50.140282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764536d4-5711-4d0c-b822-721a130aff82 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:50.140460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764536d4-5711-4d0c-b822-721a130aff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:50.159110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-764536d4-5711-4d0c-b822-721a130aff82 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:50.160395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-764536d4-5711-4d0c-b822-721a130aff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:50.168645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 690/1385] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:50.215687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e5c8-1aa6-4c62-a716-e1c33c5fc56c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:50.231144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e5c8-1aa6-4c62-a716-e1c33c5fc56c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:50.236961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b125e-267e-416e-9745-f4bb5f346620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:50.237617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b125e-267e-416e-9745-f4bb5f346620 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:50.237901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b125e-267e-416e-9745-f4bb5f346620 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:50.238178 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b125e-267e-416e-9745-f4bb5f346620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:50.247161 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b125e-267e-416e-9745-f4bb5f346620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:50.248749 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b125e-267e-416e-9745-f4bb5f346620 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:50.258915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 696/1386] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:52.818606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771413b5-c6f5-4ccc-8d57-701faa8c2f26 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:52.819134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771413b5-c6f5-4ccc-8d57-701faa8c2f26 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:52.819134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771413b5-c6f5-4ccc-8d57-701faa8c2f26 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:52.820586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 691/1387] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:52.825890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697b58-a232-4a9b-b6c2-aa711845c21b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:52.826478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697b58-a232-4a9b-b6c2-aa711845c21b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:52.826478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697b58-a232-4a9b-b6c2-aa711845c21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:52.846075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0a697b58-a232-4a9b-b6c2-aa711845c21b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:52.847281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0a697b58-a232-4a9b-b6c2-aa711845c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:52.856705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 697/1388] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:52.902888 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771413b5-c6f5-4ccc-8d57-701faa8c2f26 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:52.918299 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771413b5-c6f5-4ccc-8d57-701faa8c2f26 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:52.924004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdb970-82ce-477d-9a5e-47cbc1def678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:52.924687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb970-82ce-477d-9a5e-47cbc1def678 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:52.924990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb970-82ce-477d-9a5e-47cbc1def678 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:52.925302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb970-82ce-477d-9a5e-47cbc1def678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:52.934990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdb970-82ce-477d-9a5e-47cbc1def678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:52.936709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdb970-82ce-477d-9a5e-47cbc1def678 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:52.946736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 692/1389] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:55.716408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2941ea9-1d57-4541-aa95-f1a56c48d60b None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:55.717003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2941ea9-1d57-4541-aa95-f1a56c48d60b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:55.717003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2941ea9-1d57-4541-aa95-f1a56c48d60b None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:55.718337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 698/1390] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:55.723578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8a41-5c26-48cd-96c1-9225194d8616 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:55.724072 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8a41-5c26-48cd-96c1-9225194d8616 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:55.724212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8a41-5c26-48cd-96c1-9225194d8616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:55.742341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-855a8a41-5c26-48cd-96c1-9225194d8616 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:55.743534 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-855a8a41-5c26-48cd-96c1-9225194d8616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:55.751452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 693/1391] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:55.795840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2941ea9-1d57-4541-aa95-f1a56c48d60b None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:55.804113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=46 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:55.811186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2941ea9-1d57-4541-aa95-f1a56c48d60b None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:55.816675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d45d0b-3f13-48ad-a0cc-c82527c992f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:55.821627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d45d0b-3f13-48ad-a0cc-c82527c992f3 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:55.821627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d45d0b-3f13-48ad-a0cc-c82527c992f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:55.821627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d45d0b-3f13-48ad-a0cc-c82527c992f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:55.826700 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d45d0b-3f13-48ad-a0cc-c82527c992f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:55.828315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d45d0b-3f13-48ad-a0cc-c82527c992f3 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:55.838314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 699/1392] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:56.942050 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ec91-f312-43d0-825c-71c7e1dea5cd None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:56.942646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ec91-f312-43d0-825c-71c7e1dea5cd None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:56.942646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143ec91-f312-43d0-825c-71c7e1dea5cd None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:56.944070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 694/1393] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:56.949360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cbfdc-50ec-42ed-a33a-6a4b1a4c60fd None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:56.949787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cbfdc-50ec-42ed-a33a-6a4b1a4c60fd None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:56.949977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cbfdc-50ec-42ed-a33a-6a4b1a4c60fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:56.968507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a56cbfdc-50ec-42ed-a33a-6a4b1a4c60fd None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:56.969684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a56cbfdc-50ec-42ed-a33a-6a4b1a4c60fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:56.978236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 700/1394] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:57.033221 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf007f33-6e90-4882-8c00-9c992b43ea3b None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:57.033514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf007f33-6e90-4882-8c00-9c992b43ea3b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:57.033798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf007f33-6e90-4882-8c00-9c992b43ea3b None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:57.035168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 695/1395] 10.222.0.46 () {54 vars in 962 bytes} [Thu Jun 2 13:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:57.041066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae49a-3e36-4b61-89f6-a2466129f4cb None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:57.041358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae49a-3e36-4b61-89f6-a2466129f4cb None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:57.041637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae49a-3e36-4b61-89f6-a2466129f4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:57.088186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-996ae49a-3e36-4b61-89f6-a2466129f4cb None None] MFA Rules not processed for user `979519f42f7d463bb2ee1d5b0bb72a45`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:57.089390 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-996ae49a-3e36-4b61-89f6-a2466129f4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:57.148434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 701/1396] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Jun 2 13:12:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:57.155940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf007f33-6e90-4882-8c00-9c992b43ea3b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:57.167109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf007f33-6e90-4882-8c00-9c992b43ea3b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:57.171457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65b11e-5084-41f6-a829-461b47afdb07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '979519f42f7d463bb2ee1d5b0bb72a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:57.172136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65b11e-5084-41f6-a829-461b47afdb07 service glance] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:57.172425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65b11e-5084-41f6-a829-461b47afdb07 service glance] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:57.172714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65b11e-5084-41f6-a829-461b47afdb07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:57.183039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65b11e-5084-41f6-a829-461b47afdb07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:57.184550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65b11e-5084-41f6-a829-461b47afdb07 service glance] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:57.196253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 696/1397] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:12:57.866732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aec056-4d95-49ff-93bf-8b4d461c5678 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:57.867100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aec056-4d95-49ff-93bf-8b4d461c5678 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:57.867479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aec056-4d95-49ff-93bf-8b4d461c5678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:57.928301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-c6aec056-4d95-49ff-93bf-8b4d461c5678 None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:57.929513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c6aec056-4d95-49ff-93bf-8b4d461c5678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:57.996807 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 702/1398] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:12:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:58.038047 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c4c92-418d-4035-9fea-06649bca4dad None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:58.038526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c4c92-418d-4035-9fea-06649bca4dad None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:58.039623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c4c92-418d-4035-9fea-06649bca4dad None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:58.040156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 697/1399] 10.222.0.46 () {54 vars in 942 bytes} [Thu Jun 2 13:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:58.047183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51160475-684c-49de-a608-a148867d3ee1 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:58.047479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51160475-684c-49de-a608-a148867d3ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:58.047781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51160475-684c-49de-a608-a148867d3ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:58.098437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:12:58.102457 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-51160475-684c-49de-a608-a148867d3ee1 None None] MFA Rules not processed for user `bb4d690feb01473eaee368408c8a1dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:58.103753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-51160475-684c-49de-a608-a148867d3ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:58.198620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 703/1400] 10.222.0.46 () {58 vars in 1039 bytes} [Thu Jun 2 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:58.209117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c4c92-418d-4035-9fea-06649bca4dad None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:58.225841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c4c92-418d-4035-9fea-06649bca4dad None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:58.232231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623e99c-5abe-4823-baec-714ad55e05cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:58.233015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623e99c-5abe-4823-baec-714ad55e05cf service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:58.233382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623e99c-5abe-4823-baec-714ad55e05cf service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:58.233760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623e99c-5abe-4823-baec-714ad55e05cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:58.244956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623e99c-5abe-4823-baec-714ad55e05cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:58.247052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623e99c-5abe-4823-baec-714ad55e05cf service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:58.256811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 698/1401] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:12:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:12:58.432875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec3da5-15c5-463b-a6e3-2c45af0d7723 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:58.433186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec3da5-15c5-463b-a6e3-2c45af0d7723 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:58.433595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec3da5-15c5-463b-a6e3-2c45af0d7723 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:58.435142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 704/1402] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:12:58.440593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23bf3a-08c9-4144-b9de-13bdcc99d9ea None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:58.444603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23bf3a-08c9-4144-b9de-13bdcc99d9ea None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:58.444603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23bf3a-08c9-4144-b9de-13bdcc99d9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:58.459807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-de23bf3a-08c9-4144-b9de-13bdcc99d9ea None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:12:58.461026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-de23bf3a-08c9-4144-b9de-13bdcc99d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:12:58.468678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 699/1403] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:12:58.512616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec3da5-15c5-463b-a6e3-2c45af0d7723 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:12:58.527333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec3da5-15c5-463b-a6e3-2c45af0d7723 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:12:58.533077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fd63c-f58b-4723-9880-14ca6ed3ddbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:12:58.533732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fd63c-f58b-4723-9880-14ca6ed3ddbb service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:12:58.534018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fd63c-f58b-4723-9880-14ca6ed3ddbb service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:12:58.534297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fd63c-f58b-4723-9880-14ca6ed3ddbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:12:58.543672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fd63c-f58b-4723-9880-14ca6ed3ddbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:12:58.545367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fd63c-f58b-4723-9880-14ca6ed3ddbb service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:12:58.554827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 705/1404] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:01.081921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17568a17-f643-4cce-81f0-165e07db3b82 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:01.082901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17568a17-f643-4cce-81f0-165e07db3b82 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:01.083496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17568a17-f643-4cce-81f0-165e07db3b82 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:01.085165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 700/1405] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:01.090874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343354e-6864-4be6-845c-8332715b1a28 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:01.091358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343354e-6864-4be6-845c-8332715b1a28 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:01.091464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343354e-6864-4be6-845c-8332715b1a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:01.111208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d343354e-6864-4be6-845c-8332715b1a28 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:01.112735 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d343354e-6864-4be6-845c-8332715b1a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:01.135898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 706/1406] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:01.166045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17568a17-f643-4cce-81f0-165e07db3b82 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:01.182090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17568a17-f643-4cce-81f0-165e07db3b82 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:01.187568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b4499-644c-452c-adc1-e86035fe9055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:01.188393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4499-644c-452c-adc1-e86035fe9055 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:01.188682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4499-644c-452c-adc1-e86035fe9055 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:01.188979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4499-644c-452c-adc1-e86035fe9055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:01.201738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b4499-644c-452c-adc1-e86035fe9055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:01.203363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b4499-644c-452c-adc1-e86035fe9055 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:01.213698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 701/1407] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:11.105578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=39 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:13:11.452237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=84 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:13:22.958662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd28a6-0611-4dc6-9603-a1e8b3d72118 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:22.959838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd28a6-0611-4dc6-9603-a1e8b3d72118 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:22.959838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd28a6-0611-4dc6-9603-a1e8b3d72118 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:22.961180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 707/1408] 10.222.0.46 () {54 vars in 918 bytes} [Thu Jun 2 13:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:22.966198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9e366-4512-4260-b201-573644c13a3a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:22.966656 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9e366-4512-4260-b201-573644c13a3a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:22.966753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9e366-4512-4260-b201-573644c13a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:22.984554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-08a9e366-4512-4260-b201-573644c13a3a None None] MFA Rules not processed for user `cc0624612b2a4b1683a638b7ce4ca0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:22.985747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-08a9e366-4512-4260-b201-573644c13a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:22.994044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 702/1409] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Jun 2 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:23.008204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593c070-9211-4aa2-bb2a-b2e5395a4ecb None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:23.008490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593c070-9211-4aa2-bb2a-b2e5395a4ecb None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:23.008764 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593c070-9211-4aa2-bb2a-b2e5395a4ecb None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:23.010096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 708/1410] 10.222.0.46 () {54 vars in 918 bytes} [Thu Jun 2 13:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:23.014425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cc75-27f8-42b9-9187-8767d79a710f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:23.014714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cc75-27f8-42b9-9187-8767d79a710f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:23.014993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cc75-27f8-42b9-9187-8767d79a710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:23.032696 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-6871cc75-27f8-42b9-9187-8767d79a710f None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:23.033868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6871cc75-27f8-42b9-9187-8767d79a710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:23.042825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 703/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Jun 2 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:13:25.773848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b288-b0de-47a5-959b-fcca69b92f42 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:25.774469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b288-b0de-47a5-959b-fcca69b92f42 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:25.774469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b288-b0de-47a5-959b-fcca69b92f42 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:25.775769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 709/1412] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:25.781051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58b1a-853b-4f58-8e92-cfb36804a8a0 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:25.781462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58b1a-853b-4f58-8e92-cfb36804a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:25.781601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58b1a-853b-4f58-8e92-cfb36804a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:25.799237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-1de58b1a-853b-4f58-8e92-cfb36804a8a0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:25.800641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1de58b1a-853b-4f58-8e92-cfb36804a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:25.808815 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 704/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:13:25.851562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181b288-b0de-47a5-959b-fcca69b92f42 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:25.866251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181b288-b0de-47a5-959b-fcca69b92f42 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:25.871486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a85a07-c832-4f35-b5c0-749eb0474c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:25.872186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a85a07-c832-4f35-b5c0-749eb0474c17 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:25.872433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a85a07-c832-4f35-b5c0-749eb0474c17 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:25.872705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a85a07-c832-4f35-b5c0-749eb0474c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:25.880624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a85a07-c832-4f35-b5c0-749eb0474c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:25.882189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a85a07-c832-4f35-b5c0-749eb0474c17 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:25.891471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 710/1414] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:26.866167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b003863-d2ec-4fec-973a-2169a8c44cb7 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:26.866693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b003863-d2ec-4fec-973a-2169a8c44cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:26.866693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b003863-d2ec-4fec-973a-2169a8c44cb7 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:26.868117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 705/1415] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:26.872931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ebd52-8bed-4f09-ac05-b2c678444735 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:26.873382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ebd52-8bed-4f09-ac05-b2c678444735 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:26.873489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ebd52-8bed-4f09-ac05-b2c678444735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:26.891888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-2f2ebd52-8bed-4f09-ac05-b2c678444735 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:26.893081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2f2ebd52-8bed-4f09-ac05-b2c678444735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:26.900753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 711/1416] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:27.062435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b003863-d2ec-4fec-973a-2169a8c44cb7 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:27.077387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b003863-d2ec-4fec-973a-2169a8c44cb7 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:27.082660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098954-66b5-4181-958f-4e0926f228f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:27.083300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098954-66b5-4181-958f-4e0926f228f5 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:27.083587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098954-66b5-4181-958f-4e0926f228f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:27.083867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098954-66b5-4181-958f-4e0926f228f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:27.092152 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33098954-66b5-4181-958f-4e0926f228f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:27.093728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33098954-66b5-4181-958f-4e0926f228f5 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:27.103332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 706/1417] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:28.035852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e413c-ed55-45c0-aca4-66e8fa6b66b3 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:28.036459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e413c-ed55-45c0-aca4-66e8fa6b66b3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:28.036459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e413c-ed55-45c0-aca4-66e8fa6b66b3 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:28.038437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 712/1418] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:28.043367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0886a9-1f29-4e94-b1cd-53ba8d1218ed None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:28.043811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0886a9-1f29-4e94-b1cd-53ba8d1218ed None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:28.043968 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0886a9-1f29-4e94-b1cd-53ba8d1218ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:28.062066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-5b0886a9-1f29-4e94-b1cd-53ba8d1218ed None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:28.063245 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5b0886a9-1f29-4e94-b1cd-53ba8d1218ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:28.070954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 707/1419] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:28.221234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e413c-ed55-45c0-aca4-66e8fa6b66b3 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:28.235964 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e413c-ed55-45c0-aca4-66e8fa6b66b3 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:28.241850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccb1d2-69bf-46ef-b2db-ddacdb502672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:28.242482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccb1d2-69bf-46ef-b2db-ddacdb502672 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:28.242762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccb1d2-69bf-46ef-b2db-ddacdb502672 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:28.243036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccb1d2-69bf-46ef-b2db-ddacdb502672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:28.250975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccb1d2-69bf-46ef-b2db-ddacdb502672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:28.252589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccb1d2-69bf-46ef-b2db-ddacdb502672 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:28.262123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 713/1420] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:29.151960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a40e3-b447-4837-a099-3d6f2842cfbf None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:29.152510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a40e3-b447-4837-a099-3d6f2842cfbf None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:29.152510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a40e3-b447-4837-a099-3d6f2842cfbf None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:29.153866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 708/1421] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:29.158690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f79a91-cf85-4461-bf68-48b00a407cce None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:29.159072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f79a91-cf85-4461-bf68-48b00a407cce None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:29.159256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f79a91-cf85-4461-bf68-48b00a407cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:29.177493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-34f79a91-cf85-4461-bf68-48b00a407cce None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:29.178695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-34f79a91-cf85-4461-bf68-48b00a407cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:29.186454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 714/1422] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:29.336027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a40e3-b447-4837-a099-3d6f2842cfbf None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:29.350569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a40e3-b447-4837-a099-3d6f2842cfbf None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:29.356120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326a16f-91ca-4daa-aaad-a021b149f1c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:29.356758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326a16f-91ca-4daa-aaad-a021b149f1c7 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:29.357045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326a16f-91ca-4daa-aaad-a021b149f1c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:29.357323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326a16f-91ca-4daa-aaad-a021b149f1c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:29.365979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326a16f-91ca-4daa-aaad-a021b149f1c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:29.367558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326a16f-91ca-4daa-aaad-a021b149f1c7 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:29.376875 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 709/1423] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:30.276340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dd799-1516-40c5-a977-f376fa312303 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:30.276899 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dd799-1516-40c5-a977-f376fa312303 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:30.276899 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dd799-1516-40c5-a977-f376fa312303 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:30.278314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 715/1424] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:30.283281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65246c74-8ade-4fbd-a079-e1f19fe7c157 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:30.283690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65246c74-8ade-4fbd-a079-e1f19fe7c157 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:30.283814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65246c74-8ade-4fbd-a079-e1f19fe7c157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:30.301789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-65246c74-8ade-4fbd-a079-e1f19fe7c157 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:30.303534 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-65246c74-8ade-4fbd-a079-e1f19fe7c157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:30.311111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 710/1425] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:30.460974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dd799-1516-40c5-a977-f376fa312303 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:30.474940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dd799-1516-40c5-a977-f376fa312303 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:30.480660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ceb5e-5fc7-40f2-9cb7-a9b9cfdb92d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:30.481294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ceb5e-5fc7-40f2-9cb7-a9b9cfdb92d5 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:30.481574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ceb5e-5fc7-40f2-9cb7-a9b9cfdb92d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:30.481846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ceb5e-5fc7-40f2-9cb7-a9b9cfdb92d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:30.489713 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ceb5e-5fc7-40f2-9cb7-a9b9cfdb92d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:30.491300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ceb5e-5fc7-40f2-9cb7-a9b9cfdb92d5 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:30.500446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 716/1426] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:31.402526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2435249-7427-4786-9ea6-3ced4226b2c5 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:31.402973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2435249-7427-4786-9ea6-3ced4226b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:31.403076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2435249-7427-4786-9ea6-3ced4226b2c5 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:31.404486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 711/1427] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:31.409490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77f64d-a6ac-41e0-8e90-84d5e3673640 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:31.409908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77f64d-a6ac-41e0-8e90-84d5e3673640 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:31.410100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77f64d-a6ac-41e0-8e90-84d5e3673640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:31.428290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-be77f64d-a6ac-41e0-8e90-84d5e3673640 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:31.429487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-be77f64d-a6ac-41e0-8e90-84d5e3673640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:31.437201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 717/1428] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:31.584982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2435249-7427-4786-9ea6-3ced4226b2c5 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:31.599923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2435249-7427-4786-9ea6-3ced4226b2c5 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:31.605525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7327556-01fe-488e-aeaa-f94998e96263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:31.606159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7327556-01fe-488e-aeaa-f94998e96263 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:31.606443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7327556-01fe-488e-aeaa-f94998e96263 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:31.606741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7327556-01fe-488e-aeaa-f94998e96263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:31.614712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7327556-01fe-488e-aeaa-f94998e96263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:31.616429 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7327556-01fe-488e-aeaa-f94998e96263 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:31.625825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 712/1429] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:32.568992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017f4a4-b60c-4487-bdbe-9cad58c1fea4 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:32.569565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017f4a4-b60c-4487-bdbe-9cad58c1fea4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:32.569565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017f4a4-b60c-4487-bdbe-9cad58c1fea4 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:32.570919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 718/1430] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:32.575762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929f53d-fa66-4f37-ab27-0f38321b1377 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:32.576234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929f53d-fa66-4f37-ab27-0f38321b1377 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:32.576347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929f53d-fa66-4f37-ab27-0f38321b1377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:32.593747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9929f53d-fa66-4f37-ab27-0f38321b1377 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:32.594941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9929f53d-fa66-4f37-ab27-0f38321b1377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:32.603630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 713/1431] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:32.752315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017f4a4-b60c-4487-bdbe-9cad58c1fea4 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:32.766354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017f4a4-b60c-4487-bdbe-9cad58c1fea4 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:32.771630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34594b-187e-4422-b7d1-1fac9c5135e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:32.772310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34594b-187e-4422-b7d1-1fac9c5135e4 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:32.772591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34594b-187e-4422-b7d1-1fac9c5135e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:32.772889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34594b-187e-4422-b7d1-1fac9c5135e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:32.781062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34594b-187e-4422-b7d1-1fac9c5135e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:32.782650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34594b-187e-4422-b7d1-1fac9c5135e4 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:32.793196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 719/1432] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:33.720283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6aa63-3f37-44af-9835-f456858ad660 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:33.720855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6aa63-3f37-44af-9835-f456858ad660 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:33.720855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6aa63-3f37-44af-9835-f456858ad660 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:33.722243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 714/1433] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:33.727116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d37ef-73cf-48fe-9c08-2e525d956a19 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:33.727559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d37ef-73cf-48fe-9c08-2e525d956a19 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:33.727667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d37ef-73cf-48fe-9c08-2e525d956a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:33.746111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-bf6d37ef-73cf-48fe-9c08-2e525d956a19 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:33.747310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-bf6d37ef-73cf-48fe-9c08-2e525d956a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:33.755130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 720/1434] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:33.905424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6aa63-3f37-44af-9835-f456858ad660 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:33.919932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6aa63-3f37-44af-9835-f456858ad660 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:33.925237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89513c34-fb31-42c6-9d87-4bb7d59f58e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:33.925864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89513c34-fb31-42c6-9d87-4bb7d59f58e1 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:33.926143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89513c34-fb31-42c6-9d87-4bb7d59f58e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:33.926418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89513c34-fb31-42c6-9d87-4bb7d59f58e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:33.934341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89513c34-fb31-42c6-9d87-4bb7d59f58e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:33.935970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89513c34-fb31-42c6-9d87-4bb7d59f58e1 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:33.945504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 715/1435] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:34.859526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7101-e838-4d07-b8dd-d5534e6541ae None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:34.860109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7101-e838-4d07-b8dd-d5534e6541ae None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:34.860211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7101-e838-4d07-b8dd-d5534e6541ae None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:34.861540 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 721/1436] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:34.867147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5da51-cc22-4009-b0d6-2847c7eef381 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:34.867573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5da51-cc22-4009-b0d6-2847c7eef381 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:34.867726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5da51-cc22-4009-b0d6-2847c7eef381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:34.885681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-99c5da51-cc22-4009-b0d6-2847c7eef381 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:34.886885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-99c5da51-cc22-4009-b0d6-2847c7eef381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:34.894601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 716/1437] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:35.041938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd7101-e838-4d07-b8dd-d5534e6541ae None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:35.056777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd7101-e838-4d07-b8dd-d5534e6541ae None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:35.062155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4489c-1008-4233-9397-1684345fd5e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:35.062788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4489c-1008-4233-9397-1684345fd5e4 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:35.063067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4489c-1008-4233-9397-1684345fd5e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:35.063341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4489c-1008-4233-9397-1684345fd5e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:35.071652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4489c-1008-4233-9397-1684345fd5e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:35.073294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4489c-1008-4233-9397-1684345fd5e4 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:35.082653 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 722/1438] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:37.173113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845945-74e5-4f93-8693-2f0ee992642e None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:37.173678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845945-74e5-4f93-8693-2f0ee992642e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:37.173678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845945-74e5-4f93-8693-2f0ee992642e None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:37.175034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 717/1439] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:37.181281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4fe15-9186-4c48-a69b-c8d4dfa74fc3 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:37.181759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4fe15-9186-4c48-a69b-c8d4dfa74fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:37.181858 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4fe15-9186-4c48-a69b-c8d4dfa74fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:37.200033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f5c4fe15-9186-4c48-a69b-c8d4dfa74fc3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:37.201249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f5c4fe15-9186-4c48-a69b-c8d4dfa74fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:37.209702 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 723/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:37.263190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4433e9f-37d6-4b8c-89e8-09a635ed3880 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:37.263479 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4433e9f-37d6-4b8c-89e8-09a635ed3880 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:37.263759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4433e9f-37d6-4b8c-89e8-09a635ed3880 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:37.265176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 718/1441] 10.222.0.46 () {54 vars in 964 bytes} [Thu Jun 2 13:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:37.272008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639cfd-b153-4146-bf7e-ad15e0646e41 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:37.272298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639cfd-b153-4146-bf7e-ad15e0646e41 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:37.273930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639cfd-b153-4146-bf7e-ad15e0646e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:37.308521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0a639cfd-b153-4146-bf7e-ad15e0646e41 None None] MFA Rules not processed for user `ae7551e9626541d49a1be9330094f42e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:37.309712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0a639cfd-b153-4146-bf7e-ad15e0646e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:37.316333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 724/1442] 10.222.0.46 () {58 vars in 1061 bytes} [Thu Jun 2 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:37.325405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4433e9f-37d6-4b8c-89e8-09a635ed3880 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:37.337040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4433e9f-37d6-4b8c-89e8-09a635ed3880 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:37.340737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2143b-76d1-45eb-a2d6-0cf3bd7ef735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:37.341386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2143b-76d1-45eb-a2d6-0cf3bd7ef735 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:37.341671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2143b-76d1-45eb-a2d6-0cf3bd7ef735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:37.341947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2143b-76d1-45eb-a2d6-0cf3bd7ef735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:37.350901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2143b-76d1-45eb-a2d6-0cf3bd7ef735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:37.352367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2143b-76d1-45eb-a2d6-0cf3bd7ef735 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:37.362001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 719/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:13:40.150770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467f14f-1691-45a7-adf3-98e4423b17cd None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:40.151654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467f14f-1691-45a7-adf3-98e4423b17cd None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:40.151654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467f14f-1691-45a7-adf3-98e4423b17cd None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:40.152757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:40.158047 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb995df-576b-403d-ae4e-6696eb07138e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:40.158456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb995df-576b-403d-ae4e-6696eb07138e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:40.158612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb995df-576b-403d-ae4e-6696eb07138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:40.176402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-3fb995df-576b-403d-ae4e-6696eb07138e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:40.178168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3fb995df-576b-403d-ae4e-6696eb07138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:40.185856 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:40.223275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467f14f-1691-45a7-adf3-98e4423b17cd None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:40.235033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467f14f-1691-45a7-adf3-98e4423b17cd None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:40.238515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e76fa-d1fb-42e3-8683-76127320cce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:40.239145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e76fa-d1fb-42e3-8683-76127320cce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:40.240023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e76fa-d1fb-42e3-8683-76127320cce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:40.240301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e76fa-d1fb-42e3-8683-76127320cce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:40.249146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e76fa-d1fb-42e3-8683-76127320cce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:40.250580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e76fa-d1fb-42e3-8683-76127320cce0 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:40.259930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 726/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:42.963260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e2e35-b4bf-45f9-851a-029824931cb0 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:42.963859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e2e35-b4bf-45f9-851a-029824931cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:42.963859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e2e35-b4bf-45f9-851a-029824931cb0 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:42.965233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:42.970712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf7fbe-d7ad-4d16-8ce4-47e8ecbcf63d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:42.971128 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf7fbe-d7ad-4d16-8ce4-47e8ecbcf63d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:42.971265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf7fbe-d7ad-4d16-8ce4-47e8ecbcf63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:42.989067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7bdf7fbe-d7ad-4d16-8ce4-47e8ecbcf63d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:42.990254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7bdf7fbe-d7ad-4d16-8ce4-47e8ecbcf63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:42.999259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:43.042007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e2e35-b4bf-45f9-851a-029824931cb0 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:43.053425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e2e35-b4bf-45f9-851a-029824931cb0 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:43.057222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda985ec-5877-4c6b-b81b-ef925a6a8eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:43.057883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda985ec-5877-4c6b-b81b-ef925a6a8eeb service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:43.058197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda985ec-5877-4c6b-b81b-ef925a6a8eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:43.058524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda985ec-5877-4c6b-b81b-ef925a6a8eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:43.068617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda985ec-5877-4c6b-b81b-ef925a6a8eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:43.070061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda985ec-5877-4c6b-b81b-ef925a6a8eeb service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:43.079782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 722/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:45.568794 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7983f-061f-44df-a007-9caa2256f6f4 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:45.569616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7983f-061f-44df-a007-9caa2256f6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:45.569616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7983f-061f-44df-a007-9caa2256f6f4 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:45.571350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:45.576770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe98f4-611b-4bc8-9dd3-de755d28a405 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:45.577211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe98f4-611b-4bc8-9dd3-de755d28a405 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:45.577707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe98f4-611b-4bc8-9dd3-de755d28a405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:45.595923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-2ffe98f4-611b-4bc8-9dd3-de755d28a405 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:45.597134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2ffe98f4-611b-4bc8-9dd3-de755d28a405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:45.606046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:45.645968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7983f-061f-44df-a007-9caa2256f6f4 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:45.656553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7983f-061f-44df-a007-9caa2256f6f4 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:45.660098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57f2fa-d5fd-42c8-b1bc-93fa32d72048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:45.660733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57f2fa-d5fd-42c8-b1bc-93fa32d72048 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:45.661010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57f2fa-d5fd-42c8-b1bc-93fa32d72048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:45.661859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57f2fa-d5fd-42c8-b1bc-93fa32d72048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:45.670650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57f2fa-d5fd-42c8-b1bc-93fa32d72048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:45.672171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57f2fa-d5fd-42c8-b1bc-93fa32d72048 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:45.681570 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 729/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:48.065191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0096c20-8957-4c06-be82-8a9bbeab8e7b None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:48.065758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0096c20-8957-4c06-be82-8a9bbeab8e7b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:48.065758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0096c20-8957-4c06-be82-8a9bbeab8e7b None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:48.067138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:48.073599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc05a3c-ab52-4f1a-a7da-be2b0036be8b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:48.074042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc05a3c-ab52-4f1a-a7da-be2b0036be8b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:48.074210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc05a3c-ab52-4f1a-a7da-be2b0036be8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:48.092057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-1fc05a3c-ab52-4f1a-a7da-be2b0036be8b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:48.093265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1fc05a3c-ab52-4f1a-a7da-be2b0036be8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:48.101248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:48.140294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0096c20-8957-4c06-be82-8a9bbeab8e7b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:48.150797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0096c20-8957-4c06-be82-8a9bbeab8e7b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:48.154262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a545b4-1ef7-450c-8b25-f3f01516eb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:48.154894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a545b4-1ef7-450c-8b25-f3f01516eb9d service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:48.155174 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a545b4-1ef7-450c-8b25-f3f01516eb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:48.155447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a545b4-1ef7-450c-8b25-f3f01516eb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:48.164241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a545b4-1ef7-450c-8b25-f3f01516eb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:48.165667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a545b4-1ef7-450c-8b25-f3f01516eb9d service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:48.174892 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 725/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:50.469240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac3ce-198a-4192-b78a-c5bed5b8fd1f None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:50.469783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac3ce-198a-4192-b78a-c5bed5b8fd1f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:50.469901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac3ce-198a-4192-b78a-c5bed5b8fd1f None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:50.471189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:50.477001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f041a5-a18f-4971-b790-aa12eba39e8c None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:50.477707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f041a5-a18f-4971-b790-aa12eba39e8c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:50.477838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f041a5-a18f-4971-b790-aa12eba39e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:50.495629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-88f041a5-a18f-4971-b790-aa12eba39e8c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:50.496846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-88f041a5-a18f-4971-b790-aa12eba39e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:50.504464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:50.541506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ac3ce-198a-4192-b78a-c5bed5b8fd1f None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:50.552557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ac3ce-198a-4192-b78a-c5bed5b8fd1f None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:50.556093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88105eac-45b1-4463-a81a-732a3aded71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:50.556725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88105eac-45b1-4463-a81a-732a3aded71b service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:50.557005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88105eac-45b1-4463-a81a-732a3aded71b service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:50.557279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88105eac-45b1-4463-a81a-732a3aded71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:50.565993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88105eac-45b1-4463-a81a-732a3aded71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:50.567431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88105eac-45b1-4463-a81a-732a3aded71b service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:50.576948 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 732/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:52.892076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6cc4d-a315-49b9-ac74-a3a277bcb6d1 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:52.892630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6cc4d-a315-49b9-ac74-a3a277bcb6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:52.892630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6cc4d-a315-49b9-ac74-a3a277bcb6d1 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:52.894018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:52.899386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eae1d-5789-4bd9-90a7-be9cdd3405b8 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:52.899813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eae1d-5789-4bd9-90a7-be9cdd3405b8 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:52.899975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eae1d-5789-4bd9-90a7-be9cdd3405b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:52.905926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=79 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:13:52.918193 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-834eae1d-5789-4bd9-90a7-be9cdd3405b8 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:52.919382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-834eae1d-5789-4bd9-90a7-be9cdd3405b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:52.927600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:52.964252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6cc4d-a315-49b9-ac74-a3a277bcb6d1 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:52.969567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=73 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:13:52.975707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6cc4d-a315-49b9-ac74-a3a277bcb6d1 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:52.979458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a56cc4-b8cf-4922-830f-01ad74989687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:52.980293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56cc4-b8cf-4922-830f-01ad74989687 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:52.980585 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56cc4-b8cf-4922-830f-01ad74989687 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:52.980866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56cc4-b8cf-4922-830f-01ad74989687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:52.990344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a56cc4-b8cf-4922-830f-01ad74989687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:52.991917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a56cc4-b8cf-4922-830f-01ad74989687 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:53.002011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 728/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:55.316130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16c411-e845-4ab5-9d5c-6706319dad75 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:55.316665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16c411-e845-4ab5-9d5c-6706319dad75 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:55.316665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16c411-e845-4ab5-9d5c-6706319dad75 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:55.318067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:55.323469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f517dd-f7a8-4bbe-a2da-755354c6d280 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:55.323941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f517dd-f7a8-4bbe-a2da-755354c6d280 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:55.324042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f517dd-f7a8-4bbe-a2da-755354c6d280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:55.341867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-42f517dd-f7a8-4bbe-a2da-755354c6d280 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:55.343060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-42f517dd-f7a8-4bbe-a2da-755354c6d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:55.351389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:55.389198 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16c411-e845-4ab5-9d5c-6706319dad75 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:55.399919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16c411-e845-4ab5-9d5c-6706319dad75 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:55.403410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b186005-2380-43e5-8d60-46bf392974e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:55.404090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b186005-2380-43e5-8d60-46bf392974e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:55.404383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b186005-2380-43e5-8d60-46bf392974e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:55.404659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b186005-2380-43e5-8d60-46bf392974e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:55.413471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b186005-2380-43e5-8d60-46bf392974e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:55.414911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b186005-2380-43e5-8d60-46bf392974e6 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:55.424175 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 735/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:13:57.708874 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b24a-4155-43ff-a8e9-d2558aaa3f2e None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:57.709465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b24a-4155-43ff-a8e9-d2558aaa3f2e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:57.709465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b24a-4155-43ff-a8e9-d2558aaa3f2e None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:57.711098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:13:57.716496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862cdfc-7e6e-4ab4-a22f-7883188ae1fa None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:57.716905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862cdfc-7e6e-4ab4-a22f-7883188ae1fa None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:57.717057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862cdfc-7e6e-4ab4-a22f-7883188ae1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:57.734650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3862cdfc-7e6e-4ab4-a22f-7883188ae1fa None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:13:57.735846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3862cdfc-7e6e-4ab4-a22f-7883188ae1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:13:57.744137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:13:57.782612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4b24a-4155-43ff-a8e9-d2558aaa3f2e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:13:57.793136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4b24a-4155-43ff-a8e9-d2558aaa3f2e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:13:57.796649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1112534-4c1f-46a9-b816-f8bcc524b1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:13:57.797283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1112534-4c1f-46a9-b816-f8bcc524b1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:13:57.797568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1112534-4c1f-46a9-b816-f8bcc524b1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:13:57.797845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1112534-4c1f-46a9-b816-f8bcc524b1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:13:57.806946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1112534-4c1f-46a9-b816-f8bcc524b1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:13:57.808438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1112534-4c1f-46a9-b816-f8bcc524b1c3 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:13:57.818263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 731/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:14:00.066065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77670d-3512-45ed-a870-7d3e75e8809e None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:00.066632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77670d-3512-45ed-a870-7d3e75e8809e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:00.066632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77670d-3512-45ed-a870-7d3e75e8809e None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:00.068056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:14:00.073666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc7d3d-0c31-48a7-ad49-2502c5bb5418 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:00.074089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc7d3d-0c31-48a7-ad49-2502c5bb5418 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:00.074221 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc7d3d-0c31-48a7-ad49-2502c5bb5418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:00.092490 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-dbfc7d3d-0c31-48a7-ad49-2502c5bb5418 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:14:00.093682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-dbfc7d3d-0c31-48a7-ad49-2502c5bb5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:14:00.101753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:14:00.139985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77670d-3512-45ed-a870-7d3e75e8809e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:14:00.152300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77670d-3512-45ed-a870-7d3e75e8809e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:14:00.156090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4be495-6070-4110-96b4-34c07ad67e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:14:00.156753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be495-6070-4110-96b4-34c07ad67e2f service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:00.157036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be495-6070-4110-96b4-34c07ad67e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:00.157303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be495-6070-4110-96b4-34c07ad67e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:00.166213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4be495-6070-4110-96b4-34c07ad67e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:14:00.167659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4be495-6070-4110-96b4-34c07ad67e2f service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:14:00.177531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 738/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:14:10.086567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=17 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:14:10.172827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=17 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:14:32.205316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce32b3-68ec-4c4c-b10c-dffe2a86ab09 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:32.205897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce32b3-68ec-4c4c-b10c-dffe2a86ab09 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:32.205897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce32b3-68ec-4c4c-b10c-dffe2a86ab09 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:32.207768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 733/1471] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:14:32.213149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea6235-3905-461b-8196-e3bd38d2577b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:32.213588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea6235-3905-461b-8196-e3bd38d2577b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:32.213685 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea6235-3905-461b-8196-e3bd38d2577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:32.232093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-90ea6235-3905-461b-8196-e3bd38d2577b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:14:32.233291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-90ea6235-3905-461b-8196-e3bd38d2577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:14:32.241045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 739/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:14:32.288360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fa60f-08e9-4f25-a12c-79c60b5e02c1 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:32.288681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fa60f-08e9-4f25-a12c-79c60b5e02c1 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:32.288961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fa60f-08e9-4f25-a12c-79c60b5e02c1 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:32.290312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 734/1473] 10.222.0.46 () {54 vars in 962 bytes} [Thu Jun 2 13:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:14:32.295069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7f363-0a21-4cca-9f05-7fe305cff741 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:32.295362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7f363-0a21-4cca-9f05-7fe305cff741 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:32.295673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7f363-0a21-4cca-9f05-7fe305cff741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:32.314408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-48d7f363-0a21-4cca-9f05-7fe305cff741 None None] MFA Rules not processed for user `979519f42f7d463bb2ee1d5b0bb72a45`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:14:32.315606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-48d7f363-0a21-4cca-9f05-7fe305cff741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:14:32.322366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 740/1474] 10.222.0.46 () {58 vars in 1059 bytes} [Thu Jun 2 13:14:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:14:32.329466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fa60f-08e9-4f25-a12c-79c60b5e02c1 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:14:32.340531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fa60f-08e9-4f25-a12c-79c60b5e02c1 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:14:32.344007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174725d-e3ad-4352-a374-6d331565a0ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '979519f42f7d463bb2ee1d5b0bb72a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:14:32.344649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174725d-e3ad-4352-a374-6d331565a0ca service glance] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:32.344933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174725d-e3ad-4352-a374-6d331565a0ca service glance] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:32.345206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174725d-e3ad-4352-a374-6d331565a0ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:32.354938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174725d-e3ad-4352-a374-6d331565a0ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:14:32.356392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174725d-e3ad-4352-a374-6d331565a0ca service glance] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:14:32.365607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 735/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:14:34.706323 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601277b0-a243-493c-b8d2-ff5edad583df None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:34.706852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601277b0-a243-493c-b8d2-ff5edad583df None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:34.706852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601277b0-a243-493c-b8d2-ff5edad583df None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:34.708226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 741/1476] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:14:34.713728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9985fe5-6e6a-4543-b199-ddc1f13e07d0 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:34.714155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9985fe5-6e6a-4543-b199-ddc1f13e07d0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:34.714286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9985fe5-6e6a-4543-b199-ddc1f13e07d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:34.732321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-e9985fe5-6e6a-4543-b199-ddc1f13e07d0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:14:34.733513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e9985fe5-6e6a-4543-b199-ddc1f13e07d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:14:34.741777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 736/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:14:34.765055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601277b0-a243-493c-b8d2-ff5edad583df None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:14:34.777415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601277b0-a243-493c-b8d2-ff5edad583df None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:14:34.782039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e24a0-0b6a-4842-bccf-113d8ed9a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:14:34.782693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e24a0-0b6a-4842-bccf-113d8ed9a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:34.782975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e24a0-0b6a-4842-bccf-113d8ed9a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:34.783249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e24a0-0b6a-4842-bccf-113d8ed9a2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:34.784016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e24a0-0b6a-4842-bccf-113d8ed9a2eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:14:34.786275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WARNING py.warnings [None req-c33e24a0-0b6a-4842-bccf-113d8ed9a2eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:14:34.786275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: warnings.warn(msg) Jun 02 13:14:34.786275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: Jun 02 13:14:34.787435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e24a0-0b6a-4842-bccf-113d8ed9a2eb admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:14:34.806668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 742/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Thu Jun 2 13:14:34 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:14:37.071076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd2e57-63fb-4ad6-a359-6112c5d1fdf4 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:37.071648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd2e57-63fb-4ad6-a359-6112c5d1fdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:37.071648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd2e57-63fb-4ad6-a359-6112c5d1fdf4 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:37.073124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 737/1479] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:14:37.078770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a89e8-4f79-4de3-af39-c04d26cce777 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:37.079521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a89e8-4f79-4de3-af39-c04d26cce777 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:37.079521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a89e8-4f79-4de3-af39-c04d26cce777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:37.098227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-cc9a89e8-4f79-4de3-af39-c04d26cce777 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:14:37.099474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-cc9a89e8-4f79-4de3-af39-c04d26cce777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:14:37.107742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 743/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:14:37.152796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd2e57-63fb-4ad6-a359-6112c5d1fdf4 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:14:37.167379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd2e57-63fb-4ad6-a359-6112c5d1fdf4 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:14:37.172942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad063f-fbf8-4a1d-93e5-0b8ee6b89848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:14:37.173581 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad063f-fbf8-4a1d-93e5-0b8ee6b89848 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:37.173865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad063f-fbf8-4a1d-93e5-0b8ee6b89848 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:37.174135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad063f-fbf8-4a1d-93e5-0b8ee6b89848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:37.182410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad063f-fbf8-4a1d-93e5-0b8ee6b89848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:14:37.184188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad063f-fbf8-4a1d-93e5-0b8ee6b89848 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:14:37.194161 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 738/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:14:39.612522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95d04e-c425-48ed-85e4-e76acaa71117 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:39.613752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95d04e-c425-48ed-85e4-e76acaa71117 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:39.613752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95d04e-c425-48ed-85e4-e76acaa71117 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:39.615715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 744/1482] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:14:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:14:39.620992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b1f06-d1b0-4460-8bd5-eea419e9dd36 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:39.621416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b1f06-d1b0-4460-8bd5-eea419e9dd36 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:39.621544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b1f06-d1b0-4460-8bd5-eea419e9dd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:39.639548 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-bc7b1f06-d1b0-4460-8bd5-eea419e9dd36 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:14:39.640774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bc7b1f06-d1b0-4460-8bd5-eea419e9dd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:14:39.648459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 739/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:14:39.684497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95d04e-c425-48ed-85e4-e76acaa71117 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:14:39.695707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95d04e-c425-48ed-85e4-e76acaa71117 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:14:39.699185 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98299a05-9891-41f3-ac0c-679e0f7ae421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:14:39.699820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98299a05-9891-41f3-ac0c-679e0f7ae421 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:39.700137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98299a05-9891-41f3-ac0c-679e0f7ae421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:39.700414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98299a05-9891-41f3-ac0c-679e0f7ae421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:39.709178 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98299a05-9891-41f3-ac0c-679e0f7ae421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:14:39.710606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98299a05-9891-41f3-ac0c-679e0f7ae421 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:14:39.719860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 745/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:14:42.136296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d80e9-4c79-4990-a6fa-d33108977a01 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:42.136880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d80e9-4c79-4990-a6fa-d33108977a01 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:42.136880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d80e9-4c79-4990-a6fa-d33108977a01 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:42.138639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 740/1485] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:14:42.144245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada33a72-5091-42dc-a038-d8ed6e435dad None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:42.146908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada33a72-5091-42dc-a038-d8ed6e435dad None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:42.146908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada33a72-5091-42dc-a038-d8ed6e435dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:42.163515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ada33a72-5091-42dc-a038-d8ed6e435dad None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:14:42.164744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ada33a72-5091-42dc-a038-d8ed6e435dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:14:42.172708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 746/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:14:42.211261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d80e9-4c79-4990-a6fa-d33108977a01 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:14:42.223062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d80e9-4c79-4990-a6fa-d33108977a01 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:14:42.226926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e86414-adbf-4c8d-81dc-cf0102365174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:14:42.227554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e86414-adbf-4c8d-81dc-cf0102365174 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:42.227836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e86414-adbf-4c8d-81dc-cf0102365174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:42.228145 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e86414-adbf-4c8d-81dc-cf0102365174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:42.237272 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e86414-adbf-4c8d-81dc-cf0102365174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:14:42.239340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e86414-adbf-4c8d-81dc-cf0102365174 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:14:42.248836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 741/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:14:44.653173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee52e1-7959-43e3-b50f-6bd1eb64067e None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:44.653739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee52e1-7959-43e3-b50f-6bd1eb64067e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:44.653739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee52e1-7959-43e3-b50f-6bd1eb64067e None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:44.655061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 747/1488] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:14:44.661210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd42b26-df3a-4d34-9f3a-79f12deb86e5 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:44.661705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd42b26-df3a-4d34-9f3a-79f12deb86e5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:44.661840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd42b26-df3a-4d34-9f3a-79f12deb86e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:44.679817 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9bd42b26-df3a-4d34-9f3a-79f12deb86e5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:14:44.681045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9bd42b26-df3a-4d34-9f3a-79f12deb86e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:14:44.688929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 742/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:14:44.729488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee52e1-7959-43e3-b50f-6bd1eb64067e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:14:44.740978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee52e1-7959-43e3-b50f-6bd1eb64067e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:14:44.744506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5116e-6b0b-4df8-aaef-69d77d281c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:14:44.745148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5116e-6b0b-4df8-aaef-69d77d281c81 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:44.745436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5116e-6b0b-4df8-aaef-69d77d281c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:44.745724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5116e-6b0b-4df8-aaef-69d77d281c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:44.754659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5116e-6b0b-4df8-aaef-69d77d281c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:14:44.756356 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5116e-6b0b-4df8-aaef-69d77d281c81 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:14:44.765513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 748/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:14:47.577226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8d7ac-6f23-48af-9b70-585fba030049 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:47.577751 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8d7ac-6f23-48af-9b70-585fba030049 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:47.577751 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8d7ac-6f23-48af-9b70-585fba030049 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:47.579058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 743/1491] 10.222.0.46 () {54 vars in 926 bytes} [Thu Jun 2 13:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:14:47.584766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af6d3-42b2-4fae-a5e3-617f4ad779f2 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:47.585187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af6d3-42b2-4fae-a5e3-617f4ad779f2 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:47.585329 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af6d3-42b2-4fae-a5e3-617f4ad779f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:47.603531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-e57af6d3-42b2-4fae-a5e3-617f4ad779f2 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:14:47.604765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e57af6d3-42b2-4fae-a5e3-617f4ad779f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:14:47.612471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 749/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Thu Jun 2 13:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:14:47.652025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8d7ac-6f23-48af-9b70-585fba030049 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:14:47.662682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8d7ac-6f23-48af-9b70-585fba030049 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:14:47.666137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d474877-8cae-40b5-a55b-0381cc6783aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:14:47.666768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d474877-8cae-40b5-a55b-0381cc6783aa service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:14:47.667046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d474877-8cae-40b5-a55b-0381cc6783aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:14:47.667316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d474877-8cae-40b5-a55b-0381cc6783aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:14:47.676388 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d474877-8cae-40b5-a55b-0381cc6783aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:14:47.677792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d474877-8cae-40b5-a55b-0381cc6783aa service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:14:47.686787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 744/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:14:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:14:57.597849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=33 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:14:57.682761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=33 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:16:29.824055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32091990-006e-4775-83c3-443326881f7c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:29.824620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32091990-006e-4775-83c3-443326881f7c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:29.824620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32091990-006e-4775-83c3-443326881f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:29.842945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-32091990-006e-4775-83c3-443326881f7c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:16:29.844172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-32091990-006e-4775-83c3-443326881f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:16:29.852206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 750/1494] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:16:29.860188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ed0ab-0bc1-4723-bef8-038f9a2dab93 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:29.860715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ed0ab-0bc1-4723-bef8-038f9a2dab93 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:29.860833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ed0ab-0bc1-4723-bef8-038f9a2dab93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:29.878941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d51ed0ab-0bc1-4723-bef8-038f9a2dab93 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:16:29.880176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d51ed0ab-0bc1-4723-bef8-038f9a2dab93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:16:29.888133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 745/1495] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:16:29.893168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32091990-006e-4775-83c3-443326881f7c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:16:29.902851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32091990-006e-4775-83c3-443326881f7c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:16:29.907341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5000e-e824-4ec7-8480-bc0d2415575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:16:29.908035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5000e-e824-4ec7-8480-bc0d2415575e admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:29.908326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5000e-e824-4ec7-8480-bc0d2415575e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:29.908605 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5000e-e824-4ec7-8480-bc0d2415575e admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:29.909332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5000e-e824-4ec7-8480-bc0d2415575e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:16:29.909640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5000e-e824-4ec7-8480-bc0d2415575e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:16:29.910671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WARNING py.warnings [None req-62c5000e-e824-4ec7-8480-bc0d2415575e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:16:29.910671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: warnings.warn(msg) Jun 02 13:16:29.910671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: Jun 02 13:16:29.911555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5000e-e824-4ec7-8480-bc0d2415575e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:16:29.922906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 751/1496] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:16:29.930992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ed0ab-0bc1-4723-bef8-038f9a2dab93 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:16:29.940550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ed0ab-0bc1-4723-bef8-038f9a2dab93 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:16:29.945053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da57d6-0e16-444a-b2a3-50276007d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:16:29.945703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da57d6-0e16-444a-b2a3-50276007d75a admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:29.945989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da57d6-0e16-444a-b2a3-50276007d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:29.946263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da57d6-0e16-444a-b2a3-50276007d75a admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:29.946958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da57d6-0e16-444a-b2a3-50276007d75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:16:29.948714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: WARNING py.warnings [None req-85da57d6-0e16-444a-b2a3-50276007d75a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:16:29.948714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: warnings.warn(msg) Jun 02 13:16:29.948714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: Jun 02 13:16:29.949914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da57d6-0e16-444a-b2a3-50276007d75a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:16:30.080260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 746/1497] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:16:29 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:16:30.084396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5000e-e824-4ec7-8480-bc0d2415575e admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:16:30.094752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5000e-e824-4ec7-8480-bc0d2415575e admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:16:30.151599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e81d-22a3-4970-bad2-57016a1ccb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:16:30.152373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e81d-22a3-4970-bad2-57016a1ccb9f admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:30.152657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e81d-22a3-4970-bad2-57016a1ccb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:30.152935 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e81d-22a3-4970-bad2-57016a1ccb9f admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:30.153625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286e81d-22a3-4970-bad2-57016a1ccb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:16:30.154646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WARNING py.warnings [None req-c286e81d-22a3-4970-bad2-57016a1ccb9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:16:30.154646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: warnings.warn(msg) Jun 02 13:16:30.154646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: Jun 02 13:16:30.155860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286e81d-22a3-4970-bad2-57016a1ccb9f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:16:30.266745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 752/1498] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:16:30 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:16:30.270836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da57d6-0e16-444a-b2a3-50276007d75a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:16:30.281126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da57d6-0e16-444a-b2a3-50276007d75a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:16:30.285717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd2548-bb9a-41b2-be96-89818935fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:16:30.286377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd2548-bb9a-41b2-be96-89818935fb07 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:30.286664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd2548-bb9a-41b2-be96-89818935fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:30.286945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd2548-bb9a-41b2-be96-89818935fb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:30.287671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd2548-bb9a-41b2-be96-89818935fb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:16:30.288748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: WARNING py.warnings [None req-48dd2548-bb9a-41b2-be96-89818935fb07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:16:30.288748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: warnings.warn(msg) Jun 02 13:16:30.288748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: Jun 02 13:16:30.312410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd2548-bb9a-41b2-be96-89818935fb07 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:16:30.312410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 747/1499] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:16:30.315923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e81d-22a3-4970-bad2-57016a1ccb9f admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:16:30.325906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e81d-22a3-4970-bad2-57016a1ccb9f admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:16:30.330449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84317f-5e06-4d9f-864e-17b747765641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:16:30.331051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84317f-5e06-4d9f-864e-17b747765641 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:30.331333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84317f-5e06-4d9f-864e-17b747765641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:30.331604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84317f-5e06-4d9f-864e-17b747765641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:30.332368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84317f-5e06-4d9f-864e-17b747765641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:16:30.333382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WARNING py.warnings [None req-9d84317f-5e06-4d9f-864e-17b747765641 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:16:30.333382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: warnings.warn(msg) Jun 02 13:16:30.333382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: Jun 02 13:16:30.334254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84317f-5e06-4d9f-864e-17b747765641 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:16:30.347859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 753/1500] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:16:30.352238 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd2548-bb9a-41b2-be96-89818935fb07 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:16:30.363054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd2548-bb9a-41b2-be96-89818935fb07 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:16:30.367663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa10778-5780-4f01-854c-28e8cf7ccd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:16:30.368647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa10778-5780-4f01-854c-28e8cf7ccd7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:30.368931 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa10778-5780-4f01-854c-28e8cf7ccd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:30.369212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa10778-5780-4f01-854c-28e8cf7ccd7b admin admin] PATH_INFO: `/v3/projects/b242b222169b4191a235a6e5f20efce7/users/31c1f9e3203742089f9b34ebd662bc94/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:30.385854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa10778-5780-4f01-854c-28e8cf7ccd7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b242b222169b4191a235a6e5f20efce7, user_id=31c1f9e3203742089f9b34ebd662bc94, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:16:30.386919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: WARNING py.warnings [None req-ffa10778-5780-4f01-854c-28e8cf7ccd7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:16:30.386919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: warnings.warn(msg) Jun 02 13:16:30.386919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: Jun 02 13:16:30.388944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa10778-5780-4f01-854c-28e8cf7ccd7b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:16:30.466770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 748/1501] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:16:30 2022] PUT /identity/v3/projects/b242b222169b4191a235a6e5f20efce7/users/31c1f9e3203742089f9b34ebd662bc94/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:16:30.479348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add033e2-efac-4c78-a5bf-bd0ec6348e12 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:30.479641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add033e2-efac-4c78-a5bf-bd0ec6348e12 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:30.479955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add033e2-efac-4c78-a5bf-bd0ec6348e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:30.506580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-add033e2-efac-4c78-a5bf-bd0ec6348e12 None None] MFA Rules not processed for user `31c1f9e3203742089f9b34ebd662bc94`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:16:30.507782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-add033e2-efac-4c78-a5bf-bd0ec6348e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:16:30.569992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 754/1502] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:16:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:16:30.583279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbb9cd-83b7-4cd8-ba3f-6e715822db0f None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:30.583494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbb9cd-83b7-4cd8-ba3f-6e715822db0f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:30.583777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbb9cd-83b7-4cd8-ba3f-6e715822db0f None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:30.585185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 749/1503] 10.222.0.46 () {54 vars in 963 bytes} [Thu Jun 2 13:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:16:30.589856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6fb1-24e2-447f-9411-f441afe1065e None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:30.590147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6fb1-24e2-447f-9411-f441afe1065e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:30.590429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a6fb1-24e2-447f-9411-f441afe1065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:30.608763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-bd0a6fb1-24e2-447f-9411-f441afe1065e None None] MFA Rules not processed for user `c2bc11c0ef524d7ea5cb8704fbbfcbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:16:30.609967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-bd0a6fb1-24e2-447f-9411-f441afe1065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:16:30.652253 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:16:30.660243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 755/1504] 10.222.0.46 () {58 vars in 1060 bytes} [Thu Jun 2 13:16:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:16:30.667898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbb9cd-83b7-4cd8-ba3f-6e715822db0f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:16:30.678790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbb9cd-83b7-4cd8-ba3f-6e715822db0f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:16:30.682363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962dd15-0694-4040-86c4-e75f342202b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:16:30.684885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962dd15-0694-4040-86c4-e75f342202b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:30.684885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962dd15-0694-4040-86c4-e75f342202b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:30.684885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962dd15-0694-4040-86c4-e75f342202b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:30.691748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962dd15-0694-4040-86c4-e75f342202b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:16:30.693208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962dd15-0694-4040-86c4-e75f342202b8 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:16:30.701848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 750/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:16:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:16:30.743579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33a236-14c9-4a49-abea-ea4e2dc88cfd None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:30.743863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33a236-14c9-4a49-abea-ea4e2dc88cfd None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:30.744198 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33a236-14c9-4a49-abea-ea4e2dc88cfd None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:30.745478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 756/1506] 10.222.0.46 () {52 vars in 829 bytes} [Thu Jun 2 13:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:16:30.748998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962dd15-0694-4040-86c4-e75f342202b8 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:16:30.809027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962dd15-0694-4040-86c4-e75f342202b8 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:16:30.813526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:16:30.814378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:30.814660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:30.814935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] PATH_INFO: `/v3/users/31c1f9e3203742089f9b34ebd662bc94` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:30.816137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c1f9e3203742089f9b34ebd662bc94)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:16:30.817142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: WARNING py.warnings [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:16:30.817142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: warnings.warn(msg) Jun 02 13:16:30.817142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: Jun 02 13:16:30.818341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:16:31.045816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c1f9e3203742089f9b34ebd662bc94'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:16:31.112031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c1f9e3203742089f9b34ebd662bc94'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:16:31.130214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c1f9e3203742089f9b34ebd662bc94'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:16:31.130872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c1f9e3203742089f9b34ebd662bc94'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:16:31.140794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:16:31.145755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c1f9e3203742089f9b34ebd662bc94'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:16:31.152208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 751/1507] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:16:30 2022] DELETE /identity/v3/users/31c1f9e3203742089f9b34ebd662bc94 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:16:31.156840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcd6e6-5865-4d43-b061-63ebc0fe8361 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:31.158007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcd6e6-5865-4d43-b061-63ebc0fe8361 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:31.158123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcd6e6-5865-4d43-b061-63ebc0fe8361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:31.176530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-5efcd6e6-5865-4d43-b061-63ebc0fe8361 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:16:31.177784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5efcd6e6-5865-4d43-b061-63ebc0fe8361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:16:31.244406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 757/1508] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:16:31.258043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:16:31.259472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:16:31.317094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7de49b-bd3f-4cae-8775-118f134bb2c6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:16:31.320600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1fff9-c554-4203-9695-5ae55f432243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:16:31.321249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1fff9-c554-4203-9695-5ae55f432243 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:31.321538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1fff9-c554-4203-9695-5ae55f432243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:31.321818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1fff9-c554-4203-9695-5ae55f432243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:31.331432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1fff9-c554-4203-9695-5ae55f432243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:16:31.332934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1fff9-c554-4203-9695-5ae55f432243 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:16:31.342342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 752/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:16:31.845420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcd6e6-5865-4d43-b061-63ebc0fe8361 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:16:31.846938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5efcd6e6-5865-4d43-b061-63ebc0fe8361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:16:31.859798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcd6e6-5865-4d43-b061-63ebc0fe8361 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:16:31.868747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:16:31.868747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:16:31.868747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:16:31.868747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] PATH_INFO: `/v3/projects/b242b222169b4191a235a6e5f20efce7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:16:31.869082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b242b222169b4191a235a6e5f20efce7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:16:31.869082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WARNING py.warnings [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:16:31.869082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: warnings.warn(msg) Jun 02 13:16:31.869082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: Jun 02 13:16:31.870372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:16:32.027904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b242b222169b4191a235a6e5f20efce7', 'request_id': 'req-edf50584-a418-4216-91bf-ec641ab6059c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:16:32.041308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b242b222169b4191a235a6e5f20efce7', 'request_id': 'req-edf50584-a418-4216-91bf-ec641ab6059c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:16:32.096137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b242b222169b4191a235a6e5f20efce7', 'request_id': 'req-edf50584-a418-4216-91bf-ec641ab6059c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:16:32.107700 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] The token cache is being invalidate because project b242b222169b4191a235a6e5f20efce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:16:32.108018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:16:32.112332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-edf50584-a418-4216-91bf-ec641ab6059c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:16:32.112332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 758/1510] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:16:31 2022] DELETE /identity/v3/projects/b242b222169b4191a235a6e5f20efce7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:16:41.466211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=29 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:16:42.104685 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:18:13.107396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c1d2c-4328-44ea-8c91-843494999bcb None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:13.108470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c1d2c-4328-44ea-8c91-843494999bcb None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:13.108470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c1d2c-4328-44ea-8c91-843494999bcb None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:13.109391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:18:13.115749 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fff5d-5431-4664-8823-8221d899c2c5 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:13.116267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fff5d-5431-4664-8823-8221d899c2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:13.116497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fff5d-5431-4664-8823-8221d899c2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:13.138818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-615fff5d-5431-4664-8823-8221d899c2c5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:18:13.140336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-615fff5d-5431-4664-8823-8221d899c2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:13.202647 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:18:13.373161 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c1d2c-4328-44ea-8c91-843494999bcb None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:18:13.375254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ee9c1d2c-4328-44ea-8c91-843494999bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:13.450598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c1d2c-4328-44ea-8c91-843494999bcb None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:18:13.456848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960d300-233f-4cb8-b34e-0ab4a4d4cf6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:18:13.457503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960d300-233f-4cb8-b34e-0ab4a4d4cf6b service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:13.457791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960d300-233f-4cb8-b34e-0ab4a4d4cf6b service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:13.458082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960d300-233f-4cb8-b34e-0ab4a4d4cf6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:13.466369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960d300-233f-4cb8-b34e-0ab4a4d4cf6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:18:13.468071 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960d300-233f-4cb8-b34e-0ab4a4d4cf6b service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:18:13.478453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 754/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:18:14.360254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970e01b-a76a-4756-837c-e3f2145dd097 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:14.360797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970e01b-a76a-4756-837c-e3f2145dd097 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:14.360797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970e01b-a76a-4756-837c-e3f2145dd097 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:14.362720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:18:14.367505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab7b76-b68b-416f-aacf-83e1e7289093 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:14.367965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab7b76-b68b-416f-aacf-83e1e7289093 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:14.368106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab7b76-b68b-416f-aacf-83e1e7289093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:14.387042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d8ab7b76-b68b-416f-aacf-83e1e7289093 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:18:14.388291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d8ab7b76-b68b-416f-aacf-83e1e7289093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:14.396184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:18:14.550487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970e01b-a76a-4756-837c-e3f2145dd097 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:18:14.564511 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970e01b-a76a-4756-837c-e3f2145dd097 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:18:14.570050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fe2b4-edb1-4f67-b92a-b9fd30f0cdf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:18:14.570692 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fe2b4-edb1-4f67-b92a-b9fd30f0cdf3 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:14.570999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fe2b4-edb1-4f67-b92a-b9fd30f0cdf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:14.571254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fe2b4-edb1-4f67-b92a-b9fd30f0cdf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:14.579597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fe2b4-edb1-4f67-b92a-b9fd30f0cdf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:18:14.581228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fe2b4-edb1-4f67-b92a-b9fd30f0cdf3 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:18:14.590742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 761/1516] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:18:15.231718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55465-481f-4bfc-8ea3-2e96c447976a None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:15.232094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55465-481f-4bfc-8ea3-2e96c447976a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:15.232311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55465-481f-4bfc-8ea3-2e96c447976a None None] PATH_INFO: `/v3` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:15.233645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 756/1517] 10.222.0.44 () {54 vars in 925 bytes} [Thu Jun 2 13:18:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:18:15.239795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b892-f5a7-41fd-82b8-d2c372b9c914 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:15.240122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b892-f5a7-41fd-82b8-d2c372b9c914 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:15.240403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b892-f5a7-41fd-82b8-d2c372b9c914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:15.258981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4698b892-f5a7-41fd-82b8-d2c372b9c914 None None] MFA Rules not processed for user `cc0624612b2a4b1683a638b7ce4ca0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:18:15.260200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4698b892-f5a7-41fd-82b8-d2c372b9c914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:15.321772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 762/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Jun 2 13:18:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:18:19.624885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45927910-2e9a-4d0a-acf5-fcd74fee45da None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:19.625445 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45927910-2e9a-4d0a-acf5-fcd74fee45da None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:19.625656 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45927910-2e9a-4d0a-acf5-fcd74fee45da None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:19.627083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 757/1519] 10.222.0.46 () {54 vars in 960 bytes} [Thu Jun 2 13:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:18:19.632827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfda623-73e5-4869-8852-552a0c80d728 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:19.633291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfda623-73e5-4869-8852-552a0c80d728 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:19.633392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfda623-73e5-4869-8852-552a0c80d728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:19.653130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3bfda623-73e5-4869-8852-552a0c80d728 None None] MFA Rules not processed for user `cc0624612b2a4b1683a638b7ce4ca0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:18:19.654624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3bfda623-73e5-4869-8852-552a0c80d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:19.664290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 763/1520] 10.222.0.46 () {58 vars in 1057 bytes} [Thu Jun 2 13:18:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:18:19.671897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45927910-2e9a-4d0a-acf5-fcd74fee45da None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:18:19.686295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45927910-2e9a-4d0a-acf5-fcd74fee45da None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:18:19.691351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdef98-cfdc-49d5-9e2c-6fdc124146e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:18:19.692033 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdef98-cfdc-49d5-9e2c-6fdc124146e9 service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:19.692328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdef98-cfdc-49d5-9e2c-6fdc124146e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:19.692608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdef98-cfdc-49d5-9e2c-6fdc124146e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:19.701108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdef98-cfdc-49d5-9e2c-6fdc124146e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:18:19.702682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdef98-cfdc-49d5-9e2c-6fdc124146e9 service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:18:19.712522 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 758/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:18:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:18:25.859332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa891a1-9c29-4d2a-85ce-fafbf10eae70 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:25.859997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa891a1-9c29-4d2a-85ce-fafbf10eae70 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:25.859997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa891a1-9c29-4d2a-85ce-fafbf10eae70 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:25.861400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:18:25.866844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1330da7-db44-43ee-9dcc-cbd0416a3ac8 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:25.867270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1330da7-db44-43ee-9dcc-cbd0416a3ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:25.867411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1330da7-db44-43ee-9dcc-cbd0416a3ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:25.885374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c1330da7-db44-43ee-9dcc-cbd0416a3ac8 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:18:25.886564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c1330da7-db44-43ee-9dcc-cbd0416a3ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:25.894652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:18:26.047381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa891a1-9c29-4d2a-85ce-fafbf10eae70 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:18:26.067515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa891a1-9c29-4d2a-85ce-fafbf10eae70 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:18:26.075703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7778faa-9fc8-48b0-a292-9e7039bff4a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:18:26.076752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7778faa-9fc8-48b0-a292-9e7039bff4a7 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:26.077130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7778faa-9fc8-48b0-a292-9e7039bff4a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:26.077810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7778faa-9fc8-48b0-a292-9e7039bff4a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:26.089282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7778faa-9fc8-48b0-a292-9e7039bff4a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:18:26.091645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7778faa-9fc8-48b0-a292-9e7039bff4a7 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:18:26.102117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 765/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:18:26.981207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc902c-1c8a-4173-9809-f4f64342d879 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:26.981778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc902c-1c8a-4173-9809-f4f64342d879 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:26.981778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc902c-1c8a-4173-9809-f4f64342d879 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:26.983149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:18:26.987919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf05fa-96c7-44f5-9b1f-fd97b8be64ec None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:26.988382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf05fa-96c7-44f5-9b1f-fd97b8be64ec None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:26.988513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf05fa-96c7-44f5-9b1f-fd97b8be64ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:27.005921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-24bf05fa-96c7-44f5-9b1f-fd97b8be64ec None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:18:27.007112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-24bf05fa-96c7-44f5-9b1f-fd97b8be64ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:27.014795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:18:27.165137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc902c-1c8a-4173-9809-f4f64342d879 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:18:27.179235 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc902c-1c8a-4173-9809-f4f64342d879 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:18:27.184620 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae17ca-0e6b-40a2-9a15-c26c4076df48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:18:27.185256 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae17ca-0e6b-40a2-9a15-c26c4076df48 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:27.185534 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae17ca-0e6b-40a2-9a15-c26c4076df48 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:27.185809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae17ca-0e6b-40a2-9a15-c26c4076df48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:27.194681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae17ca-0e6b-40a2-9a15-c26c4076df48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:18:27.196381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae17ca-0e6b-40a2-9a15-c26c4076df48 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:18:27.205774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 761/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:18:31.228841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124b243-bb92-43cc-a6a1-ca971b642bb4 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:31.229415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124b243-bb92-43cc-a6a1-ca971b642bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:31.229415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124b243-bb92-43cc-a6a1-ca971b642bb4 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:31.230752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:18:31.236036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5ddf-eb59-4374-9601-222822c21602 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:31.236481 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5ddf-eb59-4374-9601-222822c21602 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:31.236609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5ddf-eb59-4374-9601-222822c21602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:31.255193 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-ed0f5ddf-eb59-4374-9601-222822c21602 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:18:31.256563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ed0f5ddf-eb59-4374-9601-222822c21602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:31.264676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:18:31.301957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124b243-bb92-43cc-a6a1-ca971b642bb4 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:18:31.303743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0124b243-bb92-43cc-a6a1-ca971b642bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:31.359735 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124b243-bb92-43cc-a6a1-ca971b642bb4 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:18:31.363782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18bec0-898b-48b9-8325-5a253c464b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:18:31.364450 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18bec0-898b-48b9-8325-5a253c464b91 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:31.364731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18bec0-898b-48b9-8325-5a253c464b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:31.365005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18bec0-898b-48b9-8325-5a253c464b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:31.373779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18bec0-898b-48b9-8325-5a253c464b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:18:31.375208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18bec0-898b-48b9-8325-5a253c464b91 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:18:31.380950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:18:31.385589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 768/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:18:33.639958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448be2-127a-4c17-9de2-a9f12bc3fad4 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:33.640488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448be2-127a-4c17-9de2-a9f12bc3fad4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:33.640488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448be2-127a-4c17-9de2-a9f12bc3fad4 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:33.641911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:18:33.647864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51558e3-71d1-4ea2-b7d7-e754b767705b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:33.648278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51558e3-71d1-4ea2-b7d7-e754b767705b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:33.648382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51558e3-71d1-4ea2-b7d7-e754b767705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:33.666773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d51558e3-71d1-4ea2-b7d7-e754b767705b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:18:33.668009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d51558e3-71d1-4ea2-b7d7-e754b767705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:33.675712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:18:33.711064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04448be2-127a-4c17-9de2-a9f12bc3fad4 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:18:33.722567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04448be2-127a-4c17-9de2-a9f12bc3fad4 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:18:33.726080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9d8f0-f7b2-433c-98ae-28b0e1964a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:18:33.726745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9d8f0-f7b2-433c-98ae-28b0e1964a49 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:33.727028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9d8f0-f7b2-433c-98ae-28b0e1964a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:33.727307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9d8f0-f7b2-433c-98ae-28b0e1964a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:33.736493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9d8f0-f7b2-433c-98ae-28b0e1964a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:18:33.737955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9d8f0-f7b2-433c-98ae-28b0e1964a49 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:18:33.747167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 764/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:18:37.519556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253f18-e786-4cbc-8f0a-ef48312e8be3 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:37.520111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253f18-e786-4cbc-8f0a-ef48312e8be3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:37.520111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253f18-e786-4cbc-8f0a-ef48312e8be3 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:37.521450 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:18:37.526611 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6132cc-ec42-407c-b467-c86862306f9a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:37.527069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6132cc-ec42-407c-b467-c86862306f9a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:37.527220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6132cc-ec42-407c-b467-c86862306f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:37.545386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-fa6132cc-ec42-407c-b467-c86862306f9a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:18:37.546559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fa6132cc-ec42-407c-b467-c86862306f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:37.554853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:18:37.820875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4253f18-e786-4cbc-8f0a-ef48312e8be3 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:18:37.822639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d4253f18-e786-4cbc-8f0a-ef48312e8be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:37.880537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4253f18-e786-4cbc-8f0a-ef48312e8be3 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:18:37.884375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90a549-4924-4b45-bc0a-de5dcc8b673a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:18:37.885031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a549-4924-4b45-bc0a-de5dcc8b673a service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:37.885317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a549-4924-4b45-bc0a-de5dcc8b673a service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:37.885596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a549-4924-4b45-bc0a-de5dcc8b673a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:37.895033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90a549-4924-4b45-bc0a-de5dcc8b673a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:18:37.896648 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90a549-4924-4b45-bc0a-de5dcc8b673a service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:18:37.906211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 771/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:18:40.183173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c02b25-1c05-4eeb-b419-948fdbbf2bff None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:40.183739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c02b25-1c05-4eeb-b419-948fdbbf2bff None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:40.183739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c02b25-1c05-4eeb-b419-948fdbbf2bff None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:40.185132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:18:40.190336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08dbe-acc1-4682-ac3b-953bebc3531c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:40.190743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08dbe-acc1-4682-ac3b-953bebc3531c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:40.190900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08dbe-acc1-4682-ac3b-953bebc3531c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:40.208939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4fa08dbe-acc1-4682-ac3b-953bebc3531c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:18:40.210145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4fa08dbe-acc1-4682-ac3b-953bebc3531c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:40.218140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:18:40.486717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c02b25-1c05-4eeb-b419-948fdbbf2bff None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:18:40.488471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-55c02b25-1c05-4eeb-b419-948fdbbf2bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:18:40.501149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c02b25-1c05-4eeb-b419-948fdbbf2bff None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:18:40.504801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f736c-b699-4c1d-8532-810c47521e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:18:40.505439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f736c-b699-4c1d-8532-810c47521e11 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:18:40.505722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f736c-b699-4c1d-8532-810c47521e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:18:40.506002 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f736c-b699-4c1d-8532-810c47521e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:18:40.514829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f736c-b699-4c1d-8532-810c47521e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:18:40.516296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f736c-b699-4c1d-8532-810c47521e11 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:18:40.526501 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 767/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:18:50.203513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=32 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:18:50.522265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=70 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:09.885700 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3218-1f7b-4d70-b4f1-002d6d8fd83c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:09.886331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3218-1f7b-4d70-b4f1-002d6d8fd83c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:09.886331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3218-1f7b-4d70-b4f1-002d6d8fd83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:09.919153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a39d3218-1f7b-4d70-b4f1-002d6d8fd83c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:09.920435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a39d3218-1f7b-4d70-b4f1-002d6d8fd83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:09.932690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 773/1540] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:09.942702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46370af3-f551-4c67-b7dc-c65f19d43ebe None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:09.943314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46370af3-f551-4c67-b7dc-c65f19d43ebe None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:09.943314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46370af3-f551-4c67-b7dc-c65f19d43ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:09.969228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-46370af3-f551-4c67-b7dc-c65f19d43ebe None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:09.970466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-46370af3-f551-4c67-b7dc-c65f19d43ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:09.982701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 768/1541] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:09.987967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3218-1f7b-4d70-b4f1-002d6d8fd83c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:10.002474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3218-1f7b-4d70-b4f1-002d6d8fd83c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:10.014194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf2d99-b2f8-45f1-baf9-c58ec150ec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:10.015072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf2d99-b2f8-45f1-baf9-c58ec150ec33 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.015364 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf2d99-b2f8-45f1-baf9-c58ec150ec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.015644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf2d99-b2f8-45f1-baf9-c58ec150ec33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.016516 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf2d99-b2f8-45f1-baf9-c58ec150ec33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:10.016958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf2d99-b2f8-45f1-baf9-c58ec150ec33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:10.018653 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf2d99-b2f8-45f1-baf9-c58ec150ec33 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:10.038277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 774/1542] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:10.046454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46370af3-f551-4c67-b7dc-c65f19d43ebe None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:10.057940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46370af3-f551-4c67-b7dc-c65f19d43ebe None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:10.069081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2b96f-99dc-4760-9376-d9dc5b8a1e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:10.070363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2b96f-99dc-4760-9376-d9dc5b8a1e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.070645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2b96f-99dc-4760-9376-d9dc5b8a1e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.070919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2b96f-99dc-4760-9376-d9dc5b8a1e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.071623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2b96f-99dc-4760-9376-d9dc5b8a1e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:10.073647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2b96f-99dc-4760-9376-d9dc5b8a1e51 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:10.199755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 769/1543] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:20:10.204009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf2d99-b2f8-45f1-baf9-c58ec150ec33 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:10.218423 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf2d99-b2f8-45f1-baf9-c58ec150ec33 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:10.313946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551385a-95cb-4f6f-9941-c98afe84e8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:10.314653 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551385a-95cb-4f6f-9941-c98afe84e8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.314940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551385a-95cb-4f6f-9941-c98afe84e8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.315218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551385a-95cb-4f6f-9941-c98afe84e8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.315942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551385a-95cb-4f6f-9941-c98afe84e8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:10.317878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551385a-95cb-4f6f-9941-c98afe84e8e0 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:10.405287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 775/1544] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:10.409056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2b96f-99dc-4760-9376-d9dc5b8a1e51 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:10.422044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2b96f-99dc-4760-9376-d9dc5b8a1e51 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:10.431445 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ac4cb-ee91-4fd6-8bdb-bf63a8c6abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:10.432155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ac4cb-ee91-4fd6-8bdb-bf63a8c6abc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.432438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ac4cb-ee91-4fd6-8bdb-bf63a8c6abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.432887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ac4cb-ee91-4fd6-8bdb-bf63a8c6abc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.433670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ac4cb-ee91-4fd6-8bdb-bf63a8c6abc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:10.435358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ac4cb-ee91-4fd6-8bdb-bf63a8c6abc2 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:10.450728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 770/1545] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:10.453003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551385a-95cb-4f6f-9941-c98afe84e8e0 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:10.453678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583498-9e10-49e1-8268-4b6a9f2499b5 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.453905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583498-9e10-49e1-8268-4b6a9f2499b5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.454187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583498-9e10-49e1-8268-4b6a9f2499b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.474423 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551385a-95cb-4f6f-9941-c98afe84e8e0 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:10.480699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-ee583498-9e10-49e1-8268-4b6a9f2499b5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:10.482124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ee583498-9e10-49e1-8268-4b6a9f2499b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:10.489608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cfcfe-7079-4978-9daa-a4983bd2b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:10.490448 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cfcfe-7079-4978-9daa-a4983bd2b927 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.490835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cfcfe-7079-4978-9daa-a4983bd2b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.494684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cfcfe-7079-4978-9daa-a4983bd2b927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.494684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cfcfe-7079-4978-9daa-a4983bd2b927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:10.494684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cfcfe-7079-4978-9daa-a4983bd2b927 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:10.501783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 771/1546] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:10.503424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b50e31-5da9-40ce-b1f9-e2077d331d8c None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.503892 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b50e31-5da9-40ce-b1f9-e2077d331d8c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.504331 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b50e31-5da9-40ce-b1f9-e2077d331d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.522041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 776/1547] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:10.523808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a40a23-1e27-4ca1-b393-61fe6df92e41 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.523808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a40a23-1e27-4ca1-b393-61fe6df92e41 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.532073 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a40a23-1e27-4ca1-b393-61fe6df92e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.533357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-44b50e31-5da9-40ce-b1f9-e2077d331d8c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:10.534731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-44b50e31-5da9-40ce-b1f9-e2077d331d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:10.557939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 772/1548] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:10.559190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b50e31-5da9-40ce-b1f9-e2077d331d8c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:10.562313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-b3a40a23-1e27-4ca1-b393-61fe6df92e41 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:10.563530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b3a40a23-1e27-4ca1-b393-61fe6df92e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:10.575783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b50e31-5da9-40ce-b1f9-e2077d331d8c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:10.582001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 777/1549] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:10.583316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3e4c-3cef-46a7-a2a2-2413f7f240fe None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.583609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3e4c-3cef-46a7-a2a2-2413f7f240fe None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.591795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3e4c-3cef-46a7-a2a2-2413f7f240fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.591958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cd562-e336-4ef9-becb-c54bf3a06338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:10.591958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cd562-e336-4ef9-becb-c54bf3a06338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.591958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cd562-e336-4ef9-becb-c54bf3a06338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.591958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cd562-e336-4ef9-becb-c54bf3a06338 admin admin] PATH_INFO: `/v3/projects/7aa4ef26a34e4e35a343427df4a8f0ef/users/ecc1e634407749c7a64fd2c10f9a8347/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.613278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cd562-e336-4ef9-becb-c54bf3a06338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa4ef26a34e4e35a343427df4a8f0ef, user_id=ecc1e634407749c7a64fd2c10f9a8347, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:10.616357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cd562-e336-4ef9-becb-c54bf3a06338 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:10.628035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-94ae3e4c-3cef-46a7-a2a2-2413f7f240fe None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:10.629658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-94ae3e4c-3cef-46a7-a2a2-2413f7f240fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:10.638851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 778/1550] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:10.640018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae3e4c-3cef-46a7-a2a2-2413f7f240fe None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:10.651429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae3e4c-3cef-46a7-a2a2-2413f7f240fe None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:10.657071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c644-10b0-479e-a0bb-e41651902071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:10.657766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c644-10b0-479e-a0bb-e41651902071 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.658050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c644-10b0-479e-a0bb-e41651902071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.658322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c644-10b0-479e-a0bb-e41651902071 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.659046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c644-10b0-479e-a0bb-e41651902071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:10.659349 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c644-10b0-479e-a0bb-e41651902071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:10.660971 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c644-10b0-479e-a0bb-e41651902071 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:10.674508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 779/1551] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:10.677718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6f1c9-e08e-439d-8ba2-3654714943a7 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.677718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6f1c9-e08e-439d-8ba2-3654714943a7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.677718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6f1c9-e08e-439d-8ba2-3654714943a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.702925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-aea6f1c9-e08e-439d-8ba2-3654714943a7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:10.704005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-aea6f1c9-e08e-439d-8ba2-3654714943a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:10.712225 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 780/1552] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:10.713668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3ef94-07bc-4e9e-85a2-033000716dc1 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.713952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3ef94-07bc-4e9e-85a2-033000716dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.714226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3ef94-07bc-4e9e-85a2-033000716dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.732495 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-40d3ef94-07bc-4e9e-85a2-033000716dc1 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:10.733018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 773/1553] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:10 2022] PUT /identity/v3/projects/7aa4ef26a34e4e35a343427df4a8f0ef/users/ecc1e634407749c7a64fd2c10f9a8347/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:10.733798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-40d3ef94-07bc-4e9e-85a2-033000716dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:10.733926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cd562-e336-4ef9-becb-c54bf3a06338 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:10.794417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 781/1554] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:10.795723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121066ed-f553-414c-bd7b-0ca284f8687c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.796047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121066ed-f553-414c-bd7b-0ca284f8687c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.796330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121066ed-f553-414c-bd7b-0ca284f8687c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.797676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cd562-e336-4ef9-becb-c54bf3a06338 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:10.802553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1f4d0-89b5-42f0-a02a-896aea24ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:10.803227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1f4d0-89b5-42f0-a02a-896aea24ec0e admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.803496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1f4d0-89b5-42f0-a02a-896aea24ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.803769 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1f4d0-89b5-42f0-a02a-896aea24ec0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.805147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1f4d0-89b5-42f0-a02a-896aea24ec0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:10.805450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1f4d0-89b5-42f0-a02a-896aea24ec0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:10.806462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: WARNING py.warnings [None req-e2d1f4d0-89b5-42f0-a02a-896aea24ec0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:20:10.806462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: warnings.warn(msg) Jun 02 13:20:10.806462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: Jun 02 13:20:10.807340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1f4d0-89b5-42f0-a02a-896aea24ec0e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:10.814489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-121066ed-f553-414c-bd7b-0ca284f8687c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:10.815750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-121066ed-f553-414c-bd7b-0ca284f8687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:10.821711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 774/1555] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:10.822805 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1f4d0-89b5-42f0-a02a-896aea24ec0e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:10.824883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 782/1556] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:10.826771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4fc39-a08d-4b9e-993f-0d8462850fe0 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.827062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4fc39-a08d-4b9e-993f-0d8462850fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.827391 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4fc39-a08d-4b9e-993f-0d8462850fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.832923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1f4d0-89b5-42f0-a02a-896aea24ec0e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:10.838764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d364e3-6594-488f-bcaa-18afe732f961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:10.839400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d364e3-6594-488f-bcaa-18afe732f961 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.840119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d364e3-6594-488f-bcaa-18afe732f961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.840881 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d364e3-6594-488f-bcaa-18afe732f961 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.841249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d364e3-6594-488f-bcaa-18afe732f961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:10.843170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d364e3-6594-488f-bcaa-18afe732f961 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:10.846231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-21b4fc39-a08d-4b9e-993f-0d8462850fe0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:10.847415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-21b4fc39-a08d-4b9e-993f-0d8462850fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:10.855761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 783/1557] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:10.859032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97d45-9c15-4de7-bfe3-c8c8f2c53cf4 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:10.859032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97d45-9c15-4de7-bfe3-c8c8f2c53cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:10.859032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97d45-9c15-4de7-bfe3-c8c8f2c53cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:10.998944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-09f97d45-9c15-4de7-bfe3-c8c8f2c53cf4 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:11.000208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-09f97d45-9c15-4de7-bfe3-c8c8f2c53cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:11.011318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 784/1558] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:11.012114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 775/1559] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:10 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:11.014743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbcf67-ae44-40b7-be8f-54030128d87c None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.015315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbcf67-ae44-40b7-be8f-54030128d87c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.015804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbcf67-ae44-40b7-be8f-54030128d87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.016500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec722093-18ae-4b07-a5bb-f5099af9bcac None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.016797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec722093-18ae-4b07-a5bb-f5099af9bcac None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.017080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec722093-18ae-4b07-a5bb-f5099af9bcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.029227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:11.035125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ec722093-18ae-4b07-a5bb-f5099af9bcac None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:11.036378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ec722093-18ae-4b07-a5bb-f5099af9bcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:11.037079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-3fcbcf67-ae44-40b7-be8f-54030128d87c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:11.038277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3fcbcf67-ae44-40b7-be8f-54030128d87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:11.087574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:11.096309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 785/1560] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:11.097799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1977a6d-2d73-44be-9385-c86f4a06f511 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.098088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1977a6d-2d73-44be-9385-c86f4a06f511 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.098363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1977a6d-2d73-44be-9385-c86f4a06f511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.100785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 776/1561] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:11.101706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbcf67-ae44-40b7-be8f-54030128d87c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.111336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbcf67-ae44-40b7-be8f-54030128d87c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.116139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a832f-d14e-4fc7-badb-dd9b7a34e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.117424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a832f-d14e-4fc7-badb-dd9b7a34e13a admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.117716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a832f-d14e-4fc7-badb-dd9b7a34e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.117997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a832f-d14e-4fc7-badb-dd9b7a34e13a admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.118728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a832f-d14e-4fc7-badb-dd9b7a34e13a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.119660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f1977a6d-2d73-44be-9385-c86f4a06f511 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:11.120677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a832f-d14e-4fc7-badb-dd9b7a34e13a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.120882 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f1977a6d-2d73-44be-9385-c86f4a06f511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:11.129167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 786/1562] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:11.130554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000a0f8-ee48-475f-8042-ab47c71c69d3 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.130846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000a0f8-ee48-475f-8042-ab47c71c69d3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.131123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000a0f8-ee48-475f-8042-ab47c71c69d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.150166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-e000a0f8-ee48-475f-8042-ab47c71c69d3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:11.151362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e000a0f8-ee48-475f-8042-ab47c71c69d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:11.159245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 787/1563] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:11.160501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d498a-8ea9-44da-818d-af8a2ba8c6d7 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.160793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d498a-8ea9-44da-818d-af8a2ba8c6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.161074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d498a-8ea9-44da-818d-af8a2ba8c6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.179584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-1b7d498a-8ea9-44da-818d-af8a2ba8c6d7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:11.180786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1b7d498a-8ea9-44da-818d-af8a2ba8c6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:11.188526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 788/1564] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:11.189279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d498a-8ea9-44da-818d-af8a2ba8c6d7 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.199059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d498a-8ea9-44da-818d-af8a2ba8c6d7 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.203044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 777/1565] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:11.203989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d154f-d2b9-480b-a8bd-bf9a555f922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.204271 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5cac9-ab76-45f2-bb6d-919275208f21 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.204634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5cac9-ab76-45f2-bb6d-919275208f21 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.204753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d154f-d2b9-480b-a8bd-bf9a555f922c admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.204857 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5cac9-ab76-45f2-bb6d-919275208f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.204948 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d154f-d2b9-480b-a8bd-bf9a555f922c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.205179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d154f-d2b9-480b-a8bd-bf9a555f922c admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.205856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d154f-d2b9-480b-a8bd-bf9a555f922c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.207834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d154f-d2b9-480b-a8bd-bf9a555f922c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.222736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0ac5cac9-ab76-45f2-bb6d-919275208f21 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:11.223981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0ac5cac9-ab76-45f2-bb6d-919275208f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:11.282742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 778/1566] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:11.287098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5cac9-ab76-45f2-bb6d-919275208f21 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.296844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5cac9-ab76-45f2-bb6d-919275208f21 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.299212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 789/1567] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:11.300177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d154f-d2b9-480b-a8bd-bf9a555f922c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.301665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76783639-fe45-4ff6-a2f2-321f55ca3951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.302343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76783639-fe45-4ff6-a2f2-321f55ca3951 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.302631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76783639-fe45-4ff6-a2f2-321f55ca3951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.302910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76783639-fe45-4ff6-a2f2-321f55ca3951 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.303637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76783639-fe45-4ff6-a2f2-321f55ca3951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:11.304706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76783639-fe45-4ff6-a2f2-321f55ca3951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.306139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76783639-fe45-4ff6-a2f2-321f55ca3951 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.325077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 779/1568] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:11.325077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76783639-fe45-4ff6-a2f2-321f55ca3951 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.334415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76783639-fe45-4ff6-a2f2-321f55ca3951 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.340148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b7851-8613-4e11-a06d-cc66d7b51a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.340801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b7851-8613-4e11-a06d-cc66d7b51a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.341085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b7851-8613-4e11-a06d-cc66d7b51a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.341363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b7851-8613-4e11-a06d-cc66d7b51a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.342111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b7851-8613-4e11-a06d-cc66d7b51a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:11.342420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b7851-8613-4e11-a06d-cc66d7b51a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.344054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b7851-8613-4e11-a06d-cc66d7b51a3d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.356900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d154f-d2b9-480b-a8bd-bf9a555f922c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.357111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 780/1569] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:11.357784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b7851-8613-4e11-a06d-cc66d7b51a3d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.368014 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b7851-8613-4e11-a06d-cc66d7b51a3d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.372736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e2082-48c3-4452-80c8-4f85c35b7d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.373397 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e2082-48c3-4452-80c8-4f85c35b7d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.373684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e2082-48c3-4452-80c8-4f85c35b7d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.373963 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e2082-48c3-4452-80c8-4f85c35b7d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.374684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e2082-48c3-4452-80c8-4f85c35b7d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:11.374990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e2082-48c3-4452-80c8-4f85c35b7d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.376684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e2082-48c3-4452-80c8-4f85c35b7d69 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.389800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 781/1570] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:11.390640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e2082-48c3-4452-80c8-4f85c35b7d69 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.402406 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e2082-48c3-4452-80c8-4f85c35b7d69 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.407118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a74b5d-9fbf-49cf-b2d8-424a8f3158dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.407808 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a74b5d-9fbf-49cf-b2d8-424a8f3158dd admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.408162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a74b5d-9fbf-49cf-b2d8-424a8f3158dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.408525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a74b5d-9fbf-49cf-b2d8-424a8f3158dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.409436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a74b5d-9fbf-49cf-b2d8-424a8f3158dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:11.409882 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a74b5d-9fbf-49cf-b2d8-424a8f3158dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.411652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a74b5d-9fbf-49cf-b2d8-424a8f3158dd admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.419416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8584-2d80-4654-ab23-508b83f1d4cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.420103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8584-2d80-4654-ab23-508b83f1d4cc service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.420386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8584-2d80-4654-ab23-508b83f1d4cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.420662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8584-2d80-4654-ab23-508b83f1d4cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.425229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 782/1571] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:11.426215 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a74b5d-9fbf-49cf-b2d8-424a8f3158dd admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.431277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8584-2d80-4654-ab23-508b83f1d4cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.433114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8584-2d80-4654-ab23-508b83f1d4cc service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.437872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a74b5d-9fbf-49cf-b2d8-424a8f3158dd admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.442449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a4f2c-4244-47ba-82a5-cdfb6a84588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.443104 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4f2c-4244-47ba-82a5-cdfb6a84588f admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.443225 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 790/1572] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:11.443392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4f2c-4244-47ba-82a5-cdfb6a84588f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.443671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4f2c-4244-47ba-82a5-cdfb6a84588f admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.444599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8584-2d80-4654-ab23-508b83f1d4cc service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.444732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a4f2c-4244-47ba-82a5-cdfb6a84588f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.445424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: WARNING py.warnings [None req-133a4f2c-4244-47ba-82a5-cdfb6a84588f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:20:11.445424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: warnings.warn(msg) Jun 02 13:20:11.445424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: Jun 02 13:20:11.446661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a4f2c-4244-47ba-82a5-cdfb6a84588f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.454461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8584-2d80-4654-ab23-508b83f1d4cc service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.462806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2fc0d-a5ca-4e9b-9aed-814ebefd81f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.463328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2fc0d-a5ca-4e9b-9aed-814ebefd81f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.465017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2fc0d-a5ca-4e9b-9aed-814ebefd81f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.465017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2fc0d-a5ca-4e9b-9aed-814ebefd81f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.465017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2fc0d-a5ca-4e9b-9aed-814ebefd81f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:11.465430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2fc0d-a5ca-4e9b-9aed-814ebefd81f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.467375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2fc0d-a5ca-4e9b-9aed-814ebefd81f4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.480578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 791/1573] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:11.484968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2fc0d-a5ca-4e9b-9aed-814ebefd81f4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.495230 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2fc0d-a5ca-4e9b-9aed-814ebefd81f4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.499981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e11a0-7fc0-47a6-8fb4-2f0de5bf8888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.500663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e11a0-7fc0-47a6-8fb4-2f0de5bf8888 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.500949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e11a0-7fc0-47a6-8fb4-2f0de5bf8888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.501227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e11a0-7fc0-47a6-8fb4-2f0de5bf8888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.501986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e11a0-7fc0-47a6-8fb4-2f0de5bf8888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.503610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e11a0-7fc0-47a6-8fb4-2f0de5bf8888 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.514017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 792/1574] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:11.514789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e11a0-7fc0-47a6-8fb4-2f0de5bf8888 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.520604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:11.524335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e11a0-7fc0-47a6-8fb4-2f0de5bf8888 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.533421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613066e-5859-4032-b344-91f329edd378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.533421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613066e-5859-4032-b344-91f329edd378 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.533421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613066e-5859-4032-b344-91f329edd378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.533421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613066e-5859-4032-b344-91f329edd378 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.533821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613066e-5859-4032-b344-91f329edd378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.533821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WARNING py.warnings [None req-8613066e-5859-4032-b344-91f329edd378 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:20:11.533821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: warnings.warn(msg) Jun 02 13:20:11.533821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: Jun 02 13:20:11.533821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613066e-5859-4032-b344-91f329edd378 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.577619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 783/1575] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:11.579164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a4f2c-4244-47ba-82a5-cdfb6a84588f admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.588764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a4f2c-4244-47ba-82a5-cdfb6a84588f admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.593610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95fd1d-7973-4335-acb5-88e3d7314927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.594241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95fd1d-7973-4335-acb5-88e3d7314927 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.594533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95fd1d-7973-4335-acb5-88e3d7314927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.594814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95fd1d-7973-4335-acb5-88e3d7314927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.595491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95fd1d-7973-4335-acb5-88e3d7314927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.597435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95fd1d-7973-4335-acb5-88e3d7314927 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.686135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 793/1576] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/projects => generated 391 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:11.686135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613066e-5859-4032-b344-91f329edd378 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.722462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 784/1577] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/projects => generated 405 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:11.726609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95fd1d-7973-4335-acb5-88e3d7314927 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.749863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613066e-5859-4032-b344-91f329edd378 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.769073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:11.789517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95fd1d-7973-4335-acb5-88e3d7314927 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:11.793349 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57a737-12a8-4808-a0a4-cab1f03a0a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.794038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57a737-12a8-4808-a0a4-cab1f03a0a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.794359 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57a737-12a8-4808-a0a4-cab1f03a0a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.794644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57a737-12a8-4808-a0a4-cab1f03a0a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.795345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57a737-12a8-4808-a0a4-cab1f03a0a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.797299 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57a737-12a8-4808-a0a4-cab1f03a0a3d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.805032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92d5a-f7a2-41d6-9384-ae785b990c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:11.805701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92d5a-f7a2-41d6-9384-ae785b990c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:11.805980 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92d5a-f7a2-41d6-9384-ae785b990c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:11.806250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92d5a-f7a2-41d6-9384-ae785b990c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:11.806934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b92d5a-f7a2-41d6-9384-ae785b990c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:11.808863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b92d5a-f7a2-41d6-9384-ae785b990c51 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:11.935582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 794/1579] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/projects => generated 371 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:11.940968 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 785/1579] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:11.941125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92d5a-f7a2-41d6-9384-ae785b990c51 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:11.941233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57a737-12a8-4808-a0a4-cab1f03a0a3d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.002461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92d5a-f7a2-41d6-9384-ae785b990c51 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.007730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dd2e4-c9a5-476d-8b5f-4f2dbfdce33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.008455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dd2e4-c9a5-476d-8b5f-4f2dbfdce33c admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.008738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dd2e4-c9a5-476d-8b5f-4f2dbfdce33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.009004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57a737-12a8-4808-a0a4-cab1f03a0a3d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.009186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dd2e4-c9a5-476d-8b5f-4f2dbfdce33c admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.009741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dd2e4-c9a5-476d-8b5f-4f2dbfdce33c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.011694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dd2e4-c9a5-476d-8b5f-4f2dbfdce33c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.014182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cadc3-1e01-42ca-961e-0e5da9a21929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.014924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cadc3-1e01-42ca-961e-0e5da9a21929 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.016957 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cadc3-1e01-42ca-961e-0e5da9a21929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.016957 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cadc3-1e01-42ca-961e-0e5da9a21929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.016957 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cadc3-1e01-42ca-961e-0e5da9a21929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.018208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cadc3-1e01-42ca-961e-0e5da9a21929 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.029083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 786/1580] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:12.030091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cadc3-1e01-42ca-961e-0e5da9a21929 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.041425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cadc3-1e01-42ca-961e-0e5da9a21929 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.045801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eb354-c9d9-468d-8008-8c550c709e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.046453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eb354-c9d9-468d-8008-8c550c709e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.046733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eb354-c9d9-468d-8008-8c550c709e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.047008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eb354-c9d9-468d-8008-8c550c709e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.047716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1eb354-c9d9-468d-8008-8c550c709e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.049392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1eb354-c9d9-468d-8008-8c550c709e02 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.059804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 787/1581] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:12.060739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eb354-c9d9-468d-8008-8c550c709e02 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.069798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eb354-c9d9-468d-8008-8c550c709e02 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.074205 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cfac4-ac49-4ac7-ba04-5ee404eb448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.074821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cfac4-ac49-4ac7-ba04-5ee404eb448d admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.075105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cfac4-ac49-4ac7-ba04-5ee404eb448d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.075381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cfac4-ac49-4ac7-ba04-5ee404eb448d admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.076074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cfac4-ac49-4ac7-ba04-5ee404eb448d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.077929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cfac4-ac49-4ac7-ba04-5ee404eb448d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.220074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:12.230436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 788/1582] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:12 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:12.230436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cfac4-ac49-4ac7-ba04-5ee404eb448d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.231077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 795/1583] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:11 2022] POST /identity/v3/projects => generated 375 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:12.231812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dd2e4-c9a5-476d-8b5f-4f2dbfdce33c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.243860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cfac4-ac49-4ac7-ba04-5ee404eb448d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.309248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac4d38-b968-4cd9-b9d4-010dd9addd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.309951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac4d38-b968-4cd9-b9d4-010dd9addd5e admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.310243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac4d38-b968-4cd9-b9d4-010dd9addd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.310520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac4d38-b968-4cd9-b9d4-010dd9addd5e admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.311216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac4d38-b968-4cd9-b9d4-010dd9addd5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.313207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac4d38-b968-4cd9-b9d4-010dd9addd5e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.327284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dd2e4-c9a5-476d-8b5f-4f2dbfdce33c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.332121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77185c1e-b470-458f-830d-08ace1454d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.332821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77185c1e-b470-458f-830d-08ace1454d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.333103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77185c1e-b470-458f-830d-08ace1454d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.333381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77185c1e-b470-458f-830d-08ace1454d99 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.334075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77185c1e-b470-458f-830d-08ace1454d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.336643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77185c1e-b470-458f-830d-08ace1454d99 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.429822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 789/1584] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:12 2022] POST /identity/v3/users => generated 303 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:12.430654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac4d38-b968-4cd9-b9d4-010dd9addd5e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.440627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac4d38-b968-4cd9-b9d4-010dd9addd5e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.445308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9af1-44b1-41ce-91b2-b1a70de55761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.446013 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9af1-44b1-41ce-91b2-b1a70de55761 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.446317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9af1-44b1-41ce-91b2-b1a70de55761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.446591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b9af1-44b1-41ce-91b2-b1a70de55761 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.447269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b9af1-44b1-41ce-91b2-b1a70de55761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.449239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b9af1-44b1-41ce-91b2-b1a70de55761 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.452895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 796/1585] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:12 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:12.454761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77185c1e-b470-458f-830d-08ace1454d99 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.464872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77185c1e-b470-458f-830d-08ace1454d99 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.469434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afef36-415b-4620-ad22-401cad535bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.470351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afef36-415b-4620-ad22-401cad535bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.470634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afef36-415b-4620-ad22-401cad535bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.470907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afef36-415b-4620-ad22-401cad535bfe admin admin] PATH_INFO: `/v3/projects/6cf137da41884a70b893f5214753fa82/users/343b4d48405447f69393092d7b29fb82/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.489103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afef36-415b-4620-ad22-401cad535bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf137da41884a70b893f5214753fa82, user_id=343b4d48405447f69393092d7b29fb82, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.490220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WARNING py.warnings [None req-13afef36-415b-4620-ad22-401cad535bfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:20:12.490220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: warnings.warn(msg) Jun 02 13:20:12.490220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: Jun 02 13:20:12.492381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afef36-415b-4620-ad22-401cad535bfe admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.552025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 790/1586] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:12 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:12.552025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9af1-44b1-41ce-91b2-b1a70de55761 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.562437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b9af1-44b1-41ce-91b2-b1a70de55761 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.567573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f3f2-d20b-4a15-9351-b87105bd58c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.568277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f3f2-d20b-4a15-9351-b87105bd58c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.568563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f3f2-d20b-4a15-9351-b87105bd58c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.568838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f3f2-d20b-4a15-9351-b87105bd58c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.569563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f3f2-d20b-4a15-9351-b87105bd58c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.571423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f3f2-d20b-4a15-9351-b87105bd58c4 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.572977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:12.582912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 791/1587] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:12.584085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f3f2-d20b-4a15-9351-b87105bd58c4 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.596574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f3f2-d20b-4a15-9351-b87105bd58c4 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.601639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516d728-2354-4bcf-bd35-5f0fc61d72b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.602296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516d728-2354-4bcf-bd35-5f0fc61d72b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.602576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516d728-2354-4bcf-bd35-5f0fc61d72b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.602865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516d728-2354-4bcf-bd35-5f0fc61d72b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.603537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516d728-2354-4bcf-bd35-5f0fc61d72b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.605469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516d728-2354-4bcf-bd35-5f0fc61d72b5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.618750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 797/1588] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:12 2022] PUT /identity/v3/projects/6cf137da41884a70b893f5214753fa82/users/343b4d48405447f69393092d7b29fb82/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:12.619602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afef36-415b-4620-ad22-401cad535bfe admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.683046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afef36-415b-4620-ad22-401cad535bfe admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.687609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8441824-0ddc-4477-a515-f4a65e1906ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.688306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8441824-0ddc-4477-a515-f4a65e1906ea admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.688590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8441824-0ddc-4477-a515-f4a65e1906ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.688868 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8441824-0ddc-4477-a515-f4a65e1906ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.689625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8441824-0ddc-4477-a515-f4a65e1906ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.691225 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8441824-0ddc-4477-a515-f4a65e1906ea admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.701428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 798/1589] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:12.702422 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8441824-0ddc-4477-a515-f4a65e1906ea admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.712382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8441824-0ddc-4477-a515-f4a65e1906ea admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.717441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4997f5-01e4-4163-86a4-754179c38f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.718092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4997f5-01e4-4163-86a4-754179c38f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.718369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4997f5-01e4-4163-86a4-754179c38f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.718654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4997f5-01e4-4163-86a4-754179c38f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.719352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4997f5-01e4-4163-86a4-754179c38f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.720957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4997f5-01e4-4163-86a4-754179c38f3c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.731101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 799/1590] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:12.732012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4997f5-01e4-4163-86a4-754179c38f3c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.736854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 792/1591] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:12 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:12.737756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516d728-2354-4bcf-bd35-5f0fc61d72b5 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.743709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4997f5-01e4-4163-86a4-754179c38f3c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.748276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1240653-0864-4f1e-8c9d-01b757027b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.749003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1240653-0864-4f1e-8c9d-01b757027b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.749300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1240653-0864-4f1e-8c9d-01b757027b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.749579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1240653-0864-4f1e-8c9d-01b757027b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.749759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516d728-2354-4bcf-bd35-5f0fc61d72b5 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.750416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1240653-0864-4f1e-8c9d-01b757027b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.752156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1240653-0864-4f1e-8c9d-01b757027b13 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.755192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7224d3e-318d-45f6-928e-a54adb90a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.755991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224d3e-318d-45f6-928e-a54adb90a4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.756287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224d3e-318d-45f6-928e-a54adb90a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.758306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224d3e-318d-45f6-928e-a54adb90a4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.758572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7224d3e-318d-45f6-928e-a54adb90a4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.760224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7224d3e-318d-45f6-928e-a54adb90a4a2 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.765717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 800/1592] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:12.767424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1240653-0864-4f1e-8c9d-01b757027b13 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.777780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 793/1593] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:12.778290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ab2e7-8985-4159-bddd-b2bc460682a8 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.778581 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ab2e7-8985-4159-bddd-b2bc460682a8 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.778865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ab2e7-8985-4159-bddd-b2bc460682a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.782733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1240653-0864-4f1e-8c9d-01b757027b13 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.788437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e0326-1065-48f2-b95b-c77ea5708ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.789536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e0326-1065-48f2-b95b-c77ea5708ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.789995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e0326-1065-48f2-b95b-c77ea5708ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.790428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e0326-1065-48f2-b95b-c77ea5708ec0 admin admin] PATH_INFO: `/v3/projects/909dabee4fb14021b27059beaae9a896/users/083c1823c3e341cc8f9ae835e41b24bf/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.807858 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e0326-1065-48f2-b95b-c77ea5708ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909dabee4fb14021b27059beaae9a896, user_id=083c1823c3e341cc8f9ae835e41b24bf, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.810599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e0326-1065-48f2-b95b-c77ea5708ec0 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.814855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a57ab2e7-8985-4159-bddd-b2bc460682a8 None None] MFA Rules not processed for user `343b4d48405447f69393092d7b29fb82`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:12.816226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a57ab2e7-8985-4159-bddd-b2bc460682a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:12.881780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 794/1594] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:12.882667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ab2e7-8985-4159-bddd-b2bc460682a8 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.892950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ab2e7-8985-4159-bddd-b2bc460682a8 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.897703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222856b-0778-4576-82ca-59bd21d8e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.898563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222856b-0778-4576-82ca-59bd21d8e16c admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.898861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222856b-0778-4576-82ca-59bd21d8e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.899147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222856b-0778-4576-82ca-59bd21d8e16c admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.899944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222856b-0778-4576-82ca-59bd21d8e16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.901569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222856b-0778-4576-82ca-59bd21d8e16c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.912339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 795/1595] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:12.913616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222856b-0778-4576-82ca-59bd21d8e16c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.925866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222856b-0778-4576-82ca-59bd21d8e16c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.931208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0933-e951-4678-97f3-f6e4584cd37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:12.931894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0933-e951-4678-97f3-f6e4584cd37f admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:12.932187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0933-e951-4678-97f3-f6e4584cd37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:12.932467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0933-e951-4678-97f3-f6e4584cd37f admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:12.933264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d0933-e951-4678-97f3-f6e4584cd37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:12.934850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d0933-e951-4678-97f3-f6e4584cd37f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:12.945051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 796/1596] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:12.945847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0933-e951-4678-97f3-f6e4584cd37f admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.955096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0933-e951-4678-97f3-f6e4584cd37f admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:12.959302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 801/1597] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:12 2022] PUT /identity/v3/projects/909dabee4fb14021b27059beaae9a896/users/083c1823c3e341cc8f9ae835e41b24bf/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:12.959302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e0326-1065-48f2-b95b-c77ea5708ec0 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:12.975192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:13.016083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45512bac-a10f-4e6b-b865-e31a73f048f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.016826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45512bac-a10f-4e6b-b865-e31a73f048f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.017106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45512bac-a10f-4e6b-b865-e31a73f048f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.017380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45512bac-a10f-4e6b-b865-e31a73f048f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.018153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45512bac-a10f-4e6b-b865-e31a73f048f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:13.019792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45512bac-a10f-4e6b-b865-e31a73f048f1 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:13.020634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e0326-1065-48f2-b95b-c77ea5708ec0 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:13.025922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fbedb-c56b-48ca-bfc0-0eb0787acb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.026676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fbedb-c56b-48ca-bfc0-0eb0787acb55 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.026885 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fbedb-c56b-48ca-bfc0-0eb0787acb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.027148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fbedb-c56b-48ca-bfc0-0eb0787acb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.027919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fbedb-c56b-48ca-bfc0-0eb0787acb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:13.029487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fbedb-c56b-48ca-bfc0-0eb0787acb55 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:13.031162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 797/1598] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:13.031939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45512bac-a10f-4e6b-b865-e31a73f048f1 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:13.042834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45512bac-a10f-4e6b-b865-e31a73f048f1 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:13.049164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0cda4-6acb-45fb-a9da-2d05448a7ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.050343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0cda4-6acb-45fb-a9da-2d05448a7ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.050811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0cda4-6acb-45fb-a9da-2d05448a7ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.051216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0cda4-6acb-45fb-a9da-2d05448a7ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.052140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0cda4-6acb-45fb-a9da-2d05448a7ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:13.054331 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0cda4-6acb-45fb-a9da-2d05448a7ac1 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:13.054789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 802/1599] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:13.057550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afdd83-1c3f-4b9f-81bf-cb84e6e4b5cc None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.058160 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afdd83-1c3f-4b9f-81bf-cb84e6e4b5cc None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.058444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afdd83-1c3f-4b9f-81bf-cb84e6e4b5cc None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.060248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 803/1600] 10.222.0.46 () {54 vars in 961 bytes} [Thu Jun 2 13:20:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:13.060963 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afdd83-1c3f-4b9f-81bf-cb84e6e4b5cc None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:13.072913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 798/1601] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:13.074125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0cda4-6acb-45fb-a9da-2d05448a7ac1 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:13.075327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afdd83-1c3f-4b9f-81bf-cb84e6e4b5cc None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:13.082179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cfe0b-0010-4027-97d2-f22a11696084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.083268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cfe0b-0010-4027-97d2-f22a11696084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.083686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cfe0b-0010-4027-97d2-f22a11696084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.083997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cfe0b-0010-4027-97d2-f22a11696084 admin admin] PATH_INFO: `/v3/projects/dd922c0d796647f8891bf4c5671e4c7b/users/5c3f539d6d374fd8b3eaa9e3e22e5cb1/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.085624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0cda4-6acb-45fb-a9da-2d05448a7ac1 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:13.092122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095b6c2-42e2-45f8-b854-3533638a1ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.093029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b6c2-42e2-45f8-b854-3533638a1ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.093731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b6c2-42e2-45f8-b854-3533638a1ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.094028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b6c2-42e2-45f8-b854-3533638a1ac7 admin admin] PATH_INFO: `/v3/projects/f867eb27e4f64a2aba64d0faefe36b41/users/d279d59933f44a62bfe4c6d67e5727bf/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.101085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cfe0b-0010-4027-97d2-f22a11696084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd922c0d796647f8891bf4c5671e4c7b, user_id=5c3f539d6d374fd8b3eaa9e3e22e5cb1, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:13.104406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cfe0b-0010-4027-97d2-f22a11696084 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:13.110397 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095b6c2-42e2-45f8-b854-3533638a1ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f867eb27e4f64a2aba64d0faefe36b41, user_id=d279d59933f44a62bfe4c6d67e5727bf, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:13.113202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095b6c2-42e2-45f8-b854-3533638a1ac7 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:13.117119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:13.223998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 804/1602] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:13 2022] PUT /identity/v3/projects/dd922c0d796647f8891bf4c5671e4c7b/users/5c3f539d6d374fd8b3eaa9e3e22e5cb1/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:13.225389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c9e5-3570-410d-bd13-f733c3e2960e None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.225690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c9e5-3570-410d-bd13-f733c3e2960e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.225961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c9e5-3570-410d-bd13-f733c3e2960e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.252950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ebf0c9e5-3570-410d-bd13-f733c3e2960e None None] MFA Rules not processed for user `083c1823c3e341cc8f9ae835e41b24bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:13.257637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ebf0c9e5-3570-410d-bd13-f733c3e2960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:13.286778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 799/1603] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:13 2022] PUT /identity/v3/projects/f867eb27e4f64a2aba64d0faefe36b41/users/d279d59933f44a62bfe4c6d67e5727bf/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:13.291739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095b6c2-42e2-45f8-b854-3533638a1ac7 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:13.328016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 805/1604] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:13.328016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0c9e5-3570-410d-bd13-f733c3e2960e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:13.354146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095b6c2-42e2-45f8-b854-3533638a1ac7 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:13.358855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f217aad-6f0d-494b-9a6f-82a2ff069c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.359529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f217aad-6f0d-494b-9a6f-82a2ff069c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.359812 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f217aad-6f0d-494b-9a6f-82a2ff069c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.360118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f217aad-6f0d-494b-9a6f-82a2ff069c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.360835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f217aad-6f0d-494b-9a6f-82a2ff069c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:13.372767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f217aad-6f0d-494b-9a6f-82a2ff069c9b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:13.376735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 800/1605] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:13.376735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d269a9-9db5-41ff-85f8-6e5b1e9d197c None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.376735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d269a9-9db5-41ff-85f8-6e5b1e9d197c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.376735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d269a9-9db5-41ff-85f8-6e5b1e9d197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.388484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0c9e5-3570-410d-bd13-f733c3e2960e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:13.394089 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb74019-aa88-49da-b44f-9c4b7b19e7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.395291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb74019-aa88-49da-b44f-9c4b7b19e7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.395580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb74019-aa88-49da-b44f-9c4b7b19e7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.395856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb74019-aa88-49da-b44f-9c4b7b19e7fb admin admin] PATH_INFO: `/v3/projects/afa347af05aa4e40b5960fd0aea87c54/users/37a7776277ca42eba4476242438fbf6d/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.396705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-08d269a9-9db5-41ff-85f8-6e5b1e9d197c None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:13.398736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-08d269a9-9db5-41ff-85f8-6e5b1e9d197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:13.410832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb74019-aa88-49da-b44f-9c4b7b19e7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa347af05aa4e40b5960fd0aea87c54, user_id=37a7776277ca42eba4476242438fbf6d, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:13.413588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb74019-aa88-49da-b44f-9c4b7b19e7fb admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:13.464412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 801/1606] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Jun 2 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:13.465514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d269a9-9db5-41ff-85f8-6e5b1e9d197c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:13.475313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d269a9-9db5-41ff-85f8-6e5b1e9d197c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:13.480432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa865f-57f6-46a4-b7f5-e92d00490125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.481308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa865f-57f6-46a4-b7f5-e92d00490125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.481598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa865f-57f6-46a4-b7f5-e92d00490125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.481878 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa865f-57f6-46a4-b7f5-e92d00490125 admin admin] PATH_INFO: `/v3/projects/b771b3811ca443d1a27cecbfda8c5a7e/users/d7910597d5d048f0aeaa1e251024513b/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.496495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa865f-57f6-46a4-b7f5-e92d00490125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b771b3811ca443d1a27cecbfda8c5a7e, user_id=d7910597d5d048f0aeaa1e251024513b, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:13.499134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa865f-57f6-46a4-b7f5-e92d00490125 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:13.537713 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 806/1607] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:13 2022] PUT /identity/v3/projects/afa347af05aa4e40b5960fd0aea87c54/users/37a7776277ca42eba4476242438fbf6d/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:13.539542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035e6a-ed4e-4375-9cea-dfe6a3f2faf7 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.539834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035e6a-ed4e-4375-9cea-dfe6a3f2faf7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.540138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035e6a-ed4e-4375-9cea-dfe6a3f2faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.565295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-6c035e6a-ed4e-4375-9cea-dfe6a3f2faf7 None None] MFA Rules not processed for user `ecc1e634407749c7a64fd2c10f9a8347`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:13.585802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6c035e6a-ed4e-4375-9cea-dfe6a3f2faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:13.629429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 807/1608] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:13.630960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a103975-d48b-496f-8af4-0e749846d252 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.631215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a103975-d48b-496f-8af4-0e749846d252 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.631489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a103975-d48b-496f-8af4-0e749846d252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.648937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-1a103975-d48b-496f-8af4-0e749846d252 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:13.650134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1a103975-d48b-496f-8af4-0e749846d252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:13.652142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 802/1609] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:13 2022] PUT /identity/v3/projects/b771b3811ca443d1a27cecbfda8c5a7e/users/d7910597d5d048f0aeaa1e251024513b/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:13.653567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc6116-9210-4c03-ac8d-bf5e4b02e817 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.653865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc6116-9210-4c03-ac8d-bf5e4b02e817 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.654145 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc6116-9210-4c03-ac8d-bf5e4b02e817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.665157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:13.681228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-73dc6116-9210-4c03-ac8d-bf5e4b02e817 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:13.682542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-73dc6116-9210-4c03-ac8d-bf5e4b02e817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:13.711432 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 808/1610] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:13.712478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a103975-d48b-496f-8af4-0e749846d252 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:13.722362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a103975-d48b-496f-8af4-0e749846d252 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:13.727853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a65ae5-0137-42f5-a16a-5b4cae53f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.728589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65ae5-0137-42f5-a16a-5b4cae53f527 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.728877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65ae5-0137-42f5-a16a-5b4cae53f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.729154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65ae5-0137-42f5-a16a-5b4cae53f527 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.729847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a65ae5-0137-42f5-a16a-5b4cae53f527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:13.731811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a65ae5-0137-42f5-a16a-5b4cae53f527 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:13.739549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:13.748945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 803/1611] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:13.749929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc6116-9210-4c03-ac8d-bf5e4b02e817 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:13.759684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc6116-9210-4c03-ac8d-bf5e4b02e817 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:13.764466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8dd76-d8cb-43d2-8c24-8a516d50521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.765397 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8dd76-d8cb-43d2-8c24-8a516d50521c admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.765676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8dd76-d8cb-43d2-8c24-8a516d50521c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.765946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8dd76-d8cb-43d2-8c24-8a516d50521c admin admin] PATH_INFO: `/v3/projects/907c2f17d46e4ebd974386bc7fae2fc9/users/a99a2ba62f3948e99f6e78cabade3685/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.783321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8dd76-d8cb-43d2-8c24-8a516d50521c admin admin] RBAC: Authorizing `identity:create_grant(project_id=907c2f17d46e4ebd974386bc7fae2fc9, user_id=a99a2ba62f3948e99f6e78cabade3685, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:13.786054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8dd76-d8cb-43d2-8c24-8a516d50521c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:13.813778 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 809/1612] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:13 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:13.814533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a65ae5-0137-42f5-a16a-5b4cae53f527 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:13.869461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 804/1613] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:13 2022] PUT /identity/v3/projects/907c2f17d46e4ebd974386bc7fae2fc9/users/a99a2ba62f3948e99f6e78cabade3685/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:13.870860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd802882-a78d-4782-9784-94e00d7fb916 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.871155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd802882-a78d-4782-9784-94e00d7fb916 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.871441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd802882-a78d-4782-9784-94e00d7fb916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.884693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a65ae5-0137-42f5-a16a-5b4cae53f527 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:13.889778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-fd802882-a78d-4782-9784-94e00d7fb916 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:13.890990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fd802882-a78d-4782-9784-94e00d7fb916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:13.928312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:13.954105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 805/1614] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:13.955571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0407-08d0-4ead-906a-8d1414c53140 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.955731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df53b-c0d1-4e92-bb5d-4866a13fdb51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:13.955850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0407-08d0-4ead-906a-8d1414c53140 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.956175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0407-08d0-4ead-906a-8d1414c53140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.956463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df53b-c0d1-4e92-bb5d-4866a13fdb51 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:13.956802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df53b-c0d1-4e92-bb5d-4866a13fdb51 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:13.957174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df53b-c0d1-4e92-bb5d-4866a13fdb51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:13.974321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-fa8c0407-08d0-4ead-906a-8d1414c53140 None None] MFA Rules not processed for user `ecc1e634407749c7a64fd2c10f9a8347`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:13.975548 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fa8c0407-08d0-4ead-906a-8d1414c53140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:14.015161 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86df53b-c0d1-4e92-bb5d-4866a13fdb51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.016844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86df53b-c0d1-4e92-bb5d-4866a13fdb51 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.026789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 810/1615] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:14.027953 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf2459-3901-4fb0-ba73-1b322b24c685 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.031033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf2459-3901-4fb0-ba73-1b322b24c685 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.031033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf2459-3901-4fb0-ba73-1b322b24c685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.032239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 806/1616] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:14.033078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0407-08d0-4ead-906a-8d1414c53140 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.034401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fa8c0407-08d0-4ead-906a-8d1414c53140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:14.087266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-64cf2459-3901-4fb0-ba73-1b322b24c685 None None] MFA Rules not processed for user `d7910597d5d048f0aeaa1e251024513b`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:14.088574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-64cf2459-3901-4fb0-ba73-1b322b24c685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:14.099258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0407-08d0-4ead-906a-8d1414c53140 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.104153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240161-4c5a-4dfa-a871-48abd23bb8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.105044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240161-4c5a-4dfa-a871-48abd23bb8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.105658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240161-4c5a-4dfa-a871-48abd23bb8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.105944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240161-4c5a-4dfa-a871-48abd23bb8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.116086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07240161-4c5a-4dfa-a871-48abd23bb8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.117676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07240161-4c5a-4dfa-a871-48abd23bb8b8 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.131979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 807/1617] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:14.133233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240161-4c5a-4dfa-a871-48abd23bb8b8 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.141695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240161-4c5a-4dfa-a871-48abd23bb8b8 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.145713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a02c8-9512-4733-b8fb-f3ddf4f6e5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.146786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a02c8-9512-4733-b8fb-f3ddf4f6e5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.146786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a02c8-9512-4733-b8fb-f3ddf4f6e5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.147030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a02c8-9512-4733-b8fb-f3ddf4f6e5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.157597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a02c8-9512-4733-b8fb-f3ddf4f6e5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.159023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a02c8-9512-4733-b8fb-f3ddf4f6e5b2 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.168026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 811/1618] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:14.169248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf2459-3901-4fb0-ba73-1b322b24c685 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.169562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 808/1619] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:14.171155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19271e-b2eb-418b-be98-b4cdd08244ee None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.171442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19271e-b2eb-418b-be98-b4cdd08244ee None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.171719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19271e-b2eb-418b-be98-b4cdd08244ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.186845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf2459-3901-4fb0-ba73-1b322b24c685 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.190704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-bf19271e-b2eb-418b-be98-b4cdd08244ee None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:14.192127 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bf19271e-b2eb-418b-be98-b4cdd08244ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:14.193367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010ea4a-061e-4d2a-8ae6-05abcc3fa2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.194990 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010ea4a-061e-4d2a-8ae6-05abcc3fa2db admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.195527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010ea4a-061e-4d2a-8ae6-05abcc3fa2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.196190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010ea4a-061e-4d2a-8ae6-05abcc3fa2db admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.197207 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010ea4a-061e-4d2a-8ae6-05abcc3fa2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.199697 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010ea4a-061e-4d2a-8ae6-05abcc3fa2db admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.201269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 809/1620] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:14.202199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19271e-b2eb-418b-be98-b4cdd08244ee None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.213896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:14.218873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19271e-b2eb-418b-be98-b4cdd08244ee None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.222565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ca0d0-5d66-4638-a158-ae286d72a2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.223267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ca0d0-5d66-4638-a158-ae286d72a2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.227476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ca0d0-5d66-4638-a158-ae286d72a2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.227476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ca0d0-5d66-4638-a158-ae286d72a2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.233992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ca0d0-5d66-4638-a158-ae286d72a2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.234936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ca0d0-5d66-4638-a158-ae286d72a2e2 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.245428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 810/1621] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:14.249475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37885ff5-2e69-4799-b64a-339b4b8f6adc None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.249779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37885ff5-2e69-4799-b64a-339b4b8f6adc None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.250060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37885ff5-2e69-4799-b64a-339b4b8f6adc None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.251432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 811/1622] 10.222.0.46 () {54 vars in 961 bytes} [Thu Jun 2 13:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:14.252147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37885ff5-2e69-4799-b64a-339b4b8f6adc None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.265046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37885ff5-2e69-4799-b64a-339b4b8f6adc None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.269956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048cff4-7b8f-4fad-b32c-89be5a42ad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.270623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048cff4-7b8f-4fad-b32c-89be5a42ad52 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.270917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048cff4-7b8f-4fad-b32c-89be5a42ad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.271189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048cff4-7b8f-4fad-b32c-89be5a42ad52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.271901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048cff4-7b8f-4fad-b32c-89be5a42ad52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.273871 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048cff4-7b8f-4fad-b32c-89be5a42ad52 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.304338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 812/1623] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:14 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:14.313560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010ea4a-061e-4d2a-8ae6-05abcc3fa2db admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.317528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010ea4a-061e-4d2a-8ae6-05abcc3fa2db admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.321558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbb80e-ed28-448d-85d7-54104b9e1aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.322276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb80e-ed28-448d-85d7-54104b9e1aca service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.322625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb80e-ed28-448d-85d7-54104b9e1aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.322991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb80e-ed28-448d-85d7-54104b9e1aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.332320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbb80e-ed28-448d-85d7-54104b9e1aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.333831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbb80e-ed28-448d-85d7-54104b9e1aca service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.344522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 813/1624] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:14.349463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a6897-379e-4ad9-9a1a-e0320c4af09b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.349843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a6897-379e-4ad9-9a1a-e0320c4af09b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.350184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a6897-379e-4ad9-9a1a-e0320c4af09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.357993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:14.378758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 812/1625] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:14 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:14.378905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-de6a6897-379e-4ad9-9a1a-e0320c4af09b None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:14.378905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-de6a6897-379e-4ad9-9a1a-e0320c4af09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:14.379086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad2331-993d-466d-9602-c398ce68d7b3 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.379086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad2331-993d-466d-9602-c398ce68d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.379086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad2331-993d-466d-9602-c398ce68d7b3 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.380392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 813/1626] 10.222.0.46 () {54 vars in 912 bytes} [Thu Jun 2 13:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:14.381306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad2331-993d-466d-9602-c398ce68d7b3 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.449900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad2331-993d-466d-9602-c398ce68d7b3 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.466776 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 814/1627] 10.222.0.46 () {58 vars in 1058 bytes} [Thu Jun 2 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:14.467647 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a6897-379e-4ad9-9a1a-e0320c4af09b None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.478001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b768519-19ad-4dde-ba2f-efc8150dce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.479294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b768519-19ad-4dde-ba2f-efc8150dce40 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.480376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b768519-19ad-4dde-ba2f-efc8150dce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.480492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a6897-379e-4ad9-9a1a-e0320c4af09b None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.480588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b768519-19ad-4dde-ba2f-efc8150dce40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.480773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b768519-19ad-4dde-ba2f-efc8150dce40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.482866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b768519-19ad-4dde-ba2f-efc8150dce40 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.489750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193ecb6-9ae1-4020-a6d8-30c45f4e1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.490742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193ecb6-9ae1-4020-a6d8-30c45f4e1c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.491814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193ecb6-9ae1-4020-a6d8-30c45f4e1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.492462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193ecb6-9ae1-4020-a6d8-30c45f4e1c3e admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.493326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193ecb6-9ae1-4020-a6d8-30c45f4e1c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.496251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193ecb6-9ae1-4020-a6d8-30c45f4e1c3e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.501491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 814/1628] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:14.503539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e7e3-2cbf-4887-905e-8c73a98b51c7 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.504146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e7e3-2cbf-4887-905e-8c73a98b51c7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.504917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e7e3-2cbf-4887-905e-8c73a98b51c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.536253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-7c96e7e3-2cbf-4887-905e-8c73a98b51c7 None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:14.539119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7c96e7e3-2cbf-4887-905e-8c73a98b51c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:14.556058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 815/1629] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:14.561770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96e7e3-2cbf-4887-905e-8c73a98b51c7 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.571311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96e7e3-2cbf-4887-905e-8c73a98b51c7 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.578584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566e73a-4243-49fb-80d9-99dec215c96e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.579450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566e73a-4243-49fb-80d9-99dec215c96e service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.579619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566e73a-4243-49fb-80d9-99dec215c96e service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.579906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566e73a-4243-49fb-80d9-99dec215c96e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.603201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 815/1630] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:14 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:14.604624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193ecb6-9ae1-4020-a6d8-30c45f4e1c3e admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.620623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193ecb6-9ae1-4020-a6d8-30c45f4e1c3e admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.627803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fc6fc-7c18-4845-8ca7-f92a9cf1296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.636242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fc6fc-7c18-4845-8ca7-f92a9cf1296b admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.636242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fc6fc-7c18-4845-8ca7-f92a9cf1296b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.636242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fc6fc-7c18-4845-8ca7-f92a9cf1296b admin admin] PATH_INFO: `/v3/projects/7537e3ac2a344679a0b9e2774923f130/users/4fb0e936ae9440c8bdf83f3cb8e0934d/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.649308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566e73a-4243-49fb-80d9-99dec215c96e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.650941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566e73a-4243-49fb-80d9-99dec215c96e service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.652356 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fc6fc-7c18-4845-8ca7-f92a9cf1296b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7537e3ac2a344679a0b9e2774923f130, user_id=4fb0e936ae9440c8bdf83f3cb8e0934d, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.662266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 816/1631] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:14.663839 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566e73a-4243-49fb-80d9-99dec215c96e service nova] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.670322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fc6fc-7c18-4845-8ca7-f92a9cf1296b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.743110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566e73a-4243-49fb-80d9-99dec215c96e service nova] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.753729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f236098-a85f-407a-a0f7-71368a7beeff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:14.756555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f236098-a85f-407a-a0f7-71368a7beeff service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:14.756880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f236098-a85f-407a-a0f7-71368a7beeff service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:14.757199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f236098-a85f-407a-a0f7-71368a7beeff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:14.782532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f236098-a85f-407a-a0f7-71368a7beeff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:14.784762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f236098-a85f-407a-a0f7-71368a7beeff service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:14.800813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 817/1632] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:14.801699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f236098-a85f-407a-a0f7-71368a7beeff service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.847866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f236098-a85f-407a-a0f7-71368a7beeff service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:14.848280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 816/1633] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:14 2022] PUT /identity/v3/projects/7537e3ac2a344679a0b9e2774923f130/users/4fb0e936ae9440c8bdf83f3cb8e0934d/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:14.852859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fc6fc-7c18-4845-8ca7-f92a9cf1296b admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:14.854619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:14.995727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fc6fc-7c18-4845-8ca7-f92a9cf1296b admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:15.003200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbffef-a4b9-4d2c-aa59-b25402d225fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:15.004059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbffef-a4b9-4d2c-aa59-b25402d225fc admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.004436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbffef-a4b9-4d2c-aa59-b25402d225fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.004836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbffef-a4b9-4d2c-aa59-b25402d225fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.005665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbffef-a4b9-4d2c-aa59-b25402d225fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:15.008673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbffef-a4b9-4d2c-aa59-b25402d225fc admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:15.015597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c587d-de76-468c-b902-a152d670ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:15.016377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c587d-de76-468c-b902-a152d670ca5b admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.020076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c587d-de76-468c-b902-a152d670ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.020076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c587d-de76-468c-b902-a152d670ca5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.020391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c587d-de76-468c-b902-a152d670ca5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:15.021841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c587d-de76-468c-b902-a152d670ca5b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:15.024958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 817/1634] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:20:15.028628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbffef-a4b9-4d2c-aa59-b25402d225fc admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:15.046749 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbffef-a4b9-4d2c-aa59-b25402d225fc admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:15.049989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 818/1635] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:15.055041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c587d-de76-468c-b902-a152d670ca5b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:15.059459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddcf44-e80f-4328-bd40-aba145ce37e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:15.060527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddcf44-e80f-4328-bd40-aba145ce37e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.060814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddcf44-e80f-4328-bd40-aba145ce37e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.061094 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddcf44-e80f-4328-bd40-aba145ce37e9 admin admin] PATH_INFO: `/v3/projects/7537e3ac2a344679a0b9e2774923f130/users/4fb0e936ae9440c8bdf83f3cb8e0934d/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.064623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddcf44-e80f-4328-bd40-aba145ce37e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7537e3ac2a344679a0b9e2774923f130, user_id=4fb0e936ae9440c8bdf83f3cb8e0934d, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:15.068609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddcf44-e80f-4328-bd40-aba145ce37e9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:15.078763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c587d-de76-468c-b902-a152d670ca5b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:15.088403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 818/1636] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:15 2022] PUT /identity/v3/projects/7537e3ac2a344679a0b9e2774923f130/users/4fb0e936ae9440c8bdf83f3cb8e0934d/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:15.090274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245c692-8d78-49ab-9123-ae741e1597f9 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.090734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245c692-8d78-49ab-9123-ae741e1597f9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.091179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245c692-8d78-49ab-9123-ae741e1597f9 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.092714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 819/1637] 10.222.0.46 () {54 vars in 912 bytes} [Thu Jun 2 13:20:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:15.098795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb310b1-6948-4068-a8fb-67ee074713fc None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.099090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb310b1-6948-4068-a8fb-67ee074713fc None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.099375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb310b1-6948-4068-a8fb-67ee074713fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.133784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-fbb310b1-6948-4068-a8fb-67ee074713fc None None] MFA Rules not processed for user `4fb0e936ae9440c8bdf83f3cb8e0934d`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:15.135082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-fbb310b1-6948-4068-a8fb-67ee074713fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:15.166039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:15.202797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cdebc-4437-44b8-8379-7873ffd53dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:15.203425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cdebc-4437-44b8-8379-7873ffd53dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.203708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cdebc-4437-44b8-8379-7873ffd53dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.204154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cdebc-4437-44b8-8379-7873ffd53dd5 admin admin] PATH_INFO: `/v3/projects/48964ff0ef154b83bff08ec2b63e56f8/users/69c5c8b1bb434d2d9bf4b5ea280d9a51/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.221809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 820/1638] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:15.226898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b803580-e0a5-413c-9896-6c6048a405a5 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.226898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b803580-e0a5-413c-9896-6c6048a405a5 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.226898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b803580-e0a5-413c-9896-6c6048a405a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.251077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4b803580-e0a5-413c-9896-6c6048a405a5 None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:15.253275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4b803580-e0a5-413c-9896-6c6048a405a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:15.262927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cdebc-4437-44b8-8379-7873ffd53dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48964ff0ef154b83bff08ec2b63e56f8, user_id=69c5c8b1bb434d2d9bf4b5ea280d9a51, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:15.265654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cdebc-4437-44b8-8379-7873ffd53dd5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:15.333760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 821/1639] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:15.334732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b803580-e0a5-413c-9896-6c6048a405a5 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:15.379577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 819/1640] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:15 2022] PUT /identity/v3/projects/48964ff0ef154b83bff08ec2b63e56f8/users/69c5c8b1bb434d2d9bf4b5ea280d9a51/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:15.379577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cdebc-4437-44b8-8379-7873ffd53dd5 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:15.384815 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-142cdebc-4437-44b8-8379-7873ffd53dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:15.460103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b803580-e0a5-413c-9896-6c6048a405a5 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:15.545400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cdebc-4437-44b8-8379-7873ffd53dd5 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:15.549383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205e5da-4179-49b0-806d-f0a2889ebb58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:15.550228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a64dd7-0251-428b-858c-8cd464644ccc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '979519f42f7d463bb2ee1d5b0bb72a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:15.551152 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a64dd7-0251-428b-858c-8cd464644ccc service glance] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.551267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205e5da-4179-49b0-806d-f0a2889ebb58 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.551464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205e5da-4179-49b0-806d-f0a2889ebb58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.551966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205e5da-4179-49b0-806d-f0a2889ebb58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.552223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a64dd7-0251-428b-858c-8cd464644ccc service glance] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.552725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a64dd7-0251-428b-858c-8cd464644ccc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.656229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a64dd7-0251-428b-858c-8cd464644ccc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:15.658319 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a64dd7-0251-428b-858c-8cd464644ccc service glance] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:15.663019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205e5da-4179-49b0-806d-f0a2889ebb58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:15.664487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205e5da-4179-49b0-806d-f0a2889ebb58 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:15.676342 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 822/1641] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:15.677511 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205e5da-4179-49b0-806d-f0a2889ebb58 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:15.707345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 820/1642] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:15.773941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205e5da-4179-49b0-806d-f0a2889ebb58 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:15.778883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c9f0a-1524-4df8-9f3c-e48715aac7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:15.779716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9f0a-1524-4df8-9f3c-e48715aac7ac admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.779856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9f0a-1524-4df8-9f3c-e48715aac7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.780146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9f0a-1524-4df8-9f3c-e48715aac7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.780920 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c9f0a-1524-4df8-9f3c-e48715aac7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:15.782651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c9f0a-1524-4df8-9f3c-e48715aac7ac admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:15.796704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 823/1643] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:15.802364 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a64dd7-0251-428b-858c-8cd464644ccc service glance] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:15.810063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a64dd7-0251-428b-858c-8cd464644ccc service glance] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:15.815438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9bf43-ff99-4c92-babe-18ae066e56ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:15.816546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9bf43-ff99-4c92-babe-18ae066e56ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.816829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9bf43-ff99-4c92-babe-18ae066e56ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.817117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9bf43-ff99-4c92-babe-18ae066e56ae admin admin] PATH_INFO: `/v3/projects/48964ff0ef154b83bff08ec2b63e56f8/users/69c5c8b1bb434d2d9bf4b5ea280d9a51/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.819383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9bf43-ff99-4c92-babe-18ae066e56ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=48964ff0ef154b83bff08ec2b63e56f8, user_id=69c5c8b1bb434d2d9bf4b5ea280d9a51, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:15.822752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9bf43-ff99-4c92-babe-18ae066e56ae admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:15.840923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 821/1644] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:15 2022] PUT /identity/v3/projects/48964ff0ef154b83bff08ec2b63e56f8/users/69c5c8b1bb434d2d9bf4b5ea280d9a51/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:20:15.853289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5336e-fcaf-4eb0-aeef-7162236187ad None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:15.853583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5336e-fcaf-4eb0-aeef-7162236187ad None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:15.853865 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5336e-fcaf-4eb0-aeef-7162236187ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:15.889030 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-36c5336e-fcaf-4eb0-aeef-7162236187ad None None] MFA Rules not processed for user `69c5c8b1bb434d2d9bf4b5ea280d9a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:15.891459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-36c5336e-fcaf-4eb0-aeef-7162236187ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:15.921190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:15.973209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 824/1645] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:16.058371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9bf43-ff99-4c92-babe-18ae066e56ae admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:16.139911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9bf43-ff99-4c92-babe-18ae066e56ae admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:16.144364 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8adc9-8be0-41bd-a647-5596927e7e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:16.145317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8adc9-8be0-41bd-a647-5596927e7e45 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:16.149398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8adc9-8be0-41bd-a647-5596927e7e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:16.149790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8adc9-8be0-41bd-a647-5596927e7e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:16.159769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a39b6-2baa-4a7c-95a5-b1f43efe963c None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:16.159769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a39b6-2baa-4a7c-95a5-b1f43efe963c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:16.160373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a39b6-2baa-4a7c-95a5-b1f43efe963c None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:16.162016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 825/1646] 10.222.0.46 () {54 vars in 912 bytes} [Thu Jun 2 13:20:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:20:16.164388 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8adc9-8be0-41bd-a647-5596927e7e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:16.165923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8adc9-8be0-41bd-a647-5596927e7e45 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:16.169574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe1b13-5d8a-4aef-ad48-bf9efcb56b29 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:16.170048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe1b13-5d8a-4aef-ad48-bf9efcb56b29 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:16.183485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe1b13-5d8a-4aef-ad48-bf9efcb56b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:16.183775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 822/1647] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:16 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:16.204382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8adc9-8be0-41bd-a647-5596927e7e45 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:16.238425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8adc9-8be0-41bd-a647-5596927e7e45 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:16.238600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4cbe1b13-5d8a-4aef-ad48-bf9efcb56b29 None None] MFA Rules not processed for user `ae7551e9626541d49a1be9330094f42e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:16.238600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4cbe1b13-5d8a-4aef-ad48-bf9efcb56b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:16.242139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996d210-1363-402f-92b7-c595b2706b71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:16.243165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996d210-1363-402f-92b7-c595b2706b71 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:16.243613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996d210-1363-402f-92b7-c595b2706b71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:16.243913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996d210-1363-402f-92b7-c595b2706b71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:16.281460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:16.330708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 826/1648] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:20:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:16.343929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996d210-1363-402f-92b7-c595b2706b71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:16.346285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996d210-1363-402f-92b7-c595b2706b71 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:16.350018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe1b13-5d8a-4aef-ad48-bf9efcb56b29 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:16.359297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 823/1649] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:16.363985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe1b13-5d8a-4aef-ad48-bf9efcb56b29 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:16.370982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138f070-ce06-4878-a65d-0883316daf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:16.371984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f070-ce06-4878-a65d-0883316daf4e service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:16.372490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f070-ce06-4878-a65d-0883316daf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:16.372769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f070-ce06-4878-a65d-0883316daf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:16.385452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138f070-ce06-4878-a65d-0883316daf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:16.387015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138f070-ce06-4878-a65d-0883316daf4e service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:16.434168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 827/1650] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:16.529941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ba44-1803-401c-8d87-7a4d209b2ad6 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:16.530535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ba44-1803-401c-8d87-7a4d209b2ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:16.531112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ba44-1803-401c-8d87-7a4d209b2ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:16.604898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-ee66ba44-1803-401c-8d87-7a4d209b2ad6 None None] MFA Rules not processed for user `d279d59933f44a62bfe4c6d67e5727bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:16.613102 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ee66ba44-1803-401c-8d87-7a4d209b2ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:16.770033 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 824/1651] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:16.777907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138f070-ce06-4878-a65d-0883316daf4e service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:16.830535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:16.837990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66ba44-1803-401c-8d87-7a4d209b2ad6 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:16.854156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66ba44-1803-401c-8d87-7a4d209b2ad6 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:16.864325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af42c-85cf-46b2-b6f2-df3ae6cdb389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:16.865070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af42c-85cf-46b2-b6f2-df3ae6cdb389 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:16.865421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af42c-85cf-46b2-b6f2-df3ae6cdb389 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:16.868956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af42c-85cf-46b2-b6f2-df3ae6cdb389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:16.931456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138f070-ce06-4878-a65d-0883316daf4e service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:16.949871 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea9b6d-8492-4a3c-bc45-7882f078e639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:16.952147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea9b6d-8492-4a3c-bc45-7882f078e639 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:16.952497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea9b6d-8492-4a3c-bc45-7882f078e639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:16.953409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea9b6d-8492-4a3c-bc45-7882f078e639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:16.955510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea9b6d-8492-4a3c-bc45-7882f078e639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:16.961604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea9b6d-8492-4a3c-bc45-7882f078e639 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:16.969492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af42c-85cf-46b2-b6f2-df3ae6cdb389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:16.974300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af42c-85cf-46b2-b6f2-df3ae6cdb389 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:17.005589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 825/1652] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:17.005589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:17.106102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 828/1653] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:16 2022] POST /identity/v3/projects => generated 403 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:17.110498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af42c-85cf-46b2-b6f2-df3ae6cdb389 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:17.122911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af42c-85cf-46b2-b6f2-df3ae6cdb389 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:17.235621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdad3f-c344-4c7a-b705-333dece9886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:17.248271 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdad3f-c344-4c7a-b705-333dece9886d admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:17.248641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdad3f-c344-4c7a-b705-333dece9886d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:17.248981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdad3f-c344-4c7a-b705-333dece9886d admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:17.250335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdad3f-c344-4c7a-b705-333dece9886d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:17.480591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdad3f-c344-4c7a-b705-333dece9886d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:17.480591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 826/1654] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:17 2022] POST /identity/v3/users => generated 308 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:17.480812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea9b6d-8492-4a3c-bc45-7882f078e639 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:17.480812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea9b6d-8492-4a3c-bc45-7882f078e639 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:17.482646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b05ae7-fc69-4043-8aea-815968eb611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:17.482646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b05ae7-fc69-4043-8aea-815968eb611a admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:17.483499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b05ae7-fc69-4043-8aea-815968eb611a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:17.483499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b05ae7-fc69-4043-8aea-815968eb611a admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:17.484957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b05ae7-fc69-4043-8aea-815968eb611a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:17.487145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b05ae7-fc69-4043-8aea-815968eb611a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:17.527789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 829/1655] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:17.532309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdad3f-c344-4c7a-b705-333dece9886d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:17.546401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdad3f-c344-4c7a-b705-333dece9886d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:17.573885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be836d-34c1-4d69-9e8b-6ae9e8d2fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:17.574810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be836d-34c1-4d69-9e8b-6ae9e8d2fdd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:17.575132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be836d-34c1-4d69-9e8b-6ae9e8d2fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:17.575409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be836d-34c1-4d69-9e8b-6ae9e8d2fdd6 admin admin] PATH_INFO: `/v3/projects/d7216eb3e53b48d495f1194f4c721ce9/users/59fb750e776b42ffbd7547baee2064a5/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:17.623562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be836d-34c1-4d69-9e8b-6ae9e8d2fdd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7216eb3e53b48d495f1194f4c721ce9, user_id=59fb750e776b42ffbd7547baee2064a5, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:17.631189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be836d-34c1-4d69-9e8b-6ae9e8d2fdd6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:17.671815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac47f68-991d-4222-87e1-48e55f4c62d7 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:17.672286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac47f68-991d-4222-87e1-48e55f4c62d7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:17.672690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac47f68-991d-4222-87e1-48e55f4c62d7 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:17.674464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 830/1656] 10.222.0.46 () {54 vars in 960 bytes} [Thu Jun 2 13:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:17.681410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c003cb-8ef1-4e01-9974-417952359d16 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:17.682500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c003cb-8ef1-4e01-9974-417952359d16 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:17.682943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c003cb-8ef1-4e01-9974-417952359d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:17.712529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-91c003cb-8ef1-4e01-9974-417952359d16 None None] MFA Rules not processed for user `cc0624612b2a4b1683a638b7ce4ca0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:17.716530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-91c003cb-8ef1-4e01-9974-417952359d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:17.746369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 827/1657] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:17 2022] PUT /identity/v3/projects/d7216eb3e53b48d495f1194f4c721ce9/users/59fb750e776b42ffbd7547baee2064a5/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:17.750116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be836d-34c1-4d69-9e8b-6ae9e8d2fdd6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:17.847906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 831/1658] 10.222.0.46 () {58 vars in 1057 bytes} [Thu Jun 2 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:17.857274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c003cb-8ef1-4e01-9974-417952359d16 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:17.905690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c003cb-8ef1-4e01-9974-417952359d16 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:17.962263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be836d-34c1-4d69-9e8b-6ae9e8d2fdd6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:17.968660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a638a-fbfd-4dad-b788-30c51b00dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:17.969533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a638a-fbfd-4dad-b788-30c51b00dcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:17.978249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a638a-fbfd-4dad-b788-30c51b00dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:17.978249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a638a-fbfd-4dad-b788-30c51b00dcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:17.978249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a638a-fbfd-4dad-b788-30c51b00dcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:17.978249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a638a-fbfd-4dad-b788-30c51b00dcf3 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:17.995336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 828/1659] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:20:18.009962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a638a-fbfd-4dad-b788-30c51b00dcf3 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:18.010279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:18.044987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ae855-5c7f-4846-a821-61239c292d7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:18.045711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ae855-5c7f-4846-a821-61239c292d7d service placement] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:18.046266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ae855-5c7f-4846-a821-61239c292d7d service placement] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:18.047372 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ae855-5c7f-4846-a821-61239c292d7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:18.048350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a638a-fbfd-4dad-b788-30c51b00dcf3 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:18.050129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9e2ae855-5c7f-4846-a821-61239c292d7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:18.059141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdf9f5-159a-46fa-b128-7b61277cc48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:18.061019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf9f5-159a-46fa-b128-7b61277cc48b admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:18.061539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf9f5-159a-46fa-b128-7b61277cc48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:18.062099 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf9f5-159a-46fa-b128-7b61277cc48b admin admin] PATH_INFO: `/v3/projects/d7216eb3e53b48d495f1194f4c721ce9/users/59fb750e776b42ffbd7547baee2064a5/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:18.065870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdf9f5-159a-46fa-b128-7b61277cc48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7216eb3e53b48d495f1194f4c721ce9, user_id=59fb750e776b42ffbd7547baee2064a5, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:18.071066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdf9f5-159a-46fa-b128-7b61277cc48b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:18.091108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ae855-5c7f-4846-a821-61239c292d7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:18.095180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ae855-5c7f-4846-a821-61239c292d7d service placement] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:18.101711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 829/1660] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:18 2022] PUT /identity/v3/projects/d7216eb3e53b48d495f1194f4c721ce9/users/59fb750e776b42ffbd7547baee2064a5/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:18.125392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 832/1661] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:20:18.635312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:21.473249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd932a14-a328-4741-8065-256cf7f52181 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:21.473876 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd932a14-a328-4741-8065-256cf7f52181 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:21.473876 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd932a14-a328-4741-8065-256cf7f52181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:21.515205 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-fd932a14-a328-4741-8065-256cf7f52181 None None] MFA Rules not processed for user `59fb750e776b42ffbd7547baee2064a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:21.516501 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fd932a14-a328-4741-8065-256cf7f52181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:21.611480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 830/1662] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:23.237005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9eb67-24b8-4d60-90e7-b9d1dfeac887 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:23.237588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9eb67-24b8-4d60-90e7-b9d1dfeac887 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:23.237588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9eb67-24b8-4d60-90e7-b9d1dfeac887 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:23.239627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 833/1663] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:23.247290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4def3d-470f-4adc-bacd-fd0be49b1020 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:23.248137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4def3d-470f-4adc-bacd-fd0be49b1020 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:23.249865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4def3d-470f-4adc-bacd-fd0be49b1020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:23.285147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-1c4def3d-470f-4adc-bacd-fd0be49b1020 None None] MFA Rules not processed for user `cc0624612b2a4b1683a638b7ce4ca0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:23.286781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1c4def3d-470f-4adc-bacd-fd0be49b1020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:23.450067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 831/1664] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:20:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:23.707768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9eb67-24b8-4d60-90e7-b9d1dfeac887 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:23.736512 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9eb67-24b8-4d60-90e7-b9d1dfeac887 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:23.747039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5266906-ad6f-4cce-99e9-4effcda1bfe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:23.748119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266906-ad6f-4cce-99e9-4effcda1bfe2 service placement] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:23.749486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266906-ad6f-4cce-99e9-4effcda1bfe2 service placement] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:23.751096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5266906-ad6f-4cce-99e9-4effcda1bfe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:23.771768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5266906-ad6f-4cce-99e9-4effcda1bfe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:23.774142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5266906-ad6f-4cce-99e9-4effcda1bfe2 service placement] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:23.790689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 834/1665] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:25.937955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53dacd-1a50-4358-befe-7e07677655e5 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:25.939029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53dacd-1a50-4358-befe-7e07677655e5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:25.939349 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53dacd-1a50-4358-befe-7e07677655e5 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:25.941699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 832/1666] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:20:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:26.139706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc712-a0b4-42f5-a22a-945da5c33996 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:26.140738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc712-a0b4-42f5-a22a-945da5c33996 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:26.141229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc712-a0b4-42f5-a22a-945da5c33996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:26.200877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-af5fc712-a0b4-42f5-a22a-945da5c33996 None None] MFA Rules not processed for user `cc0624612b2a4b1683a638b7ce4ca0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:26.204696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-af5fc712-a0b4-42f5-a22a-945da5c33996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:26.254938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 835/1667] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:20:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:26.278660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53dacd-1a50-4358-befe-7e07677655e5 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:26.332807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53dacd-1a50-4358-befe-7e07677655e5 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:26.335284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc712-a0b4-42f5-a22a-945da5c33996 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:26.360842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8ae3b-f1fa-4e27-98b5-9daabc58dd3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:26.369189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8ae3b-f1fa-4e27-98b5-9daabc58dd3b service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:26.370197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8ae3b-f1fa-4e27-98b5-9daabc58dd3b service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:26.370504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8ae3b-f1fa-4e27-98b5-9daabc58dd3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:26.406646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8ae3b-f1fa-4e27-98b5-9daabc58dd3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:26.417911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8ae3b-f1fa-4e27-98b5-9daabc58dd3b service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:26.460334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 833/1668] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:20:26.516568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fedc40-7cab-4b5c-8bed-2f95ec9d6567 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:26.516857 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fedc40-7cab-4b5c-8bed-2f95ec9d6567 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:26.517129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fedc40-7cab-4b5c-8bed-2f95ec9d6567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:26.548148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d4fedc40-7cab-4b5c-8bed-2f95ec9d6567 None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:26.555114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d4fedc40-7cab-4b5c-8bed-2f95ec9d6567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:26.568561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc712-a0b4-42f5-a22a-945da5c33996 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:26.580938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:26.589585 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:26.590121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:26.590592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] PATH_INFO: `/v3/users/d279d59933f44a62bfe4c6d67e5727bf` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:26.594924 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d279d59933f44a62bfe4c6d67e5727bf)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:26.598290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: WARNING py.warnings [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:20:26.598290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: warnings.warn(msg) Jun 02 13:20:26.598290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: Jun 02 13:20:26.599859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:26.668463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:26.724612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 834/1669] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:20:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 02 13:20:27.071767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd279d59933f44a62bfe4c6d67e5727bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:27.180564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd279d59933f44a62bfe4c6d67e5727bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:27.239377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd279d59933f44a62bfe4c6d67e5727bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:27.240239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd279d59933f44a62bfe4c6d67e5727bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:27.267136 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-89ce5f9f-d840-4ede-a290-08e00e7c244d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd279d59933f44a62bfe4c6d67e5727bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:27.280882 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 836/1670] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:26 2022] DELETE /identity/v3/users/d279d59933f44a62bfe4c6d67e5727bf => generated 0 bytes in 943 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:20:27.303086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fedc40-7cab-4b5c-8bed-2f95ec9d6567 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:27.305913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d4fedc40-7cab-4b5c-8bed-2f95ec9d6567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:27.533082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fedc40-7cab-4b5c-8bed-2f95ec9d6567 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:27.732012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e07b1-106b-4d2b-99cd-a27740962545 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:27.732685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e07b1-106b-4d2b-99cd-a27740962545 service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:27.732967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e07b1-106b-4d2b-99cd-a27740962545 service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:27.733240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e07b1-106b-4d2b-99cd-a27740962545 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:27.735336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b38e07b1-106b-4d2b-99cd-a27740962545 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:27.837163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e07b1-106b-4d2b-99cd-a27740962545 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:27.838780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e07b1-106b-4d2b-99cd-a27740962545 service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:27.850436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 835/1671] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:20:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:20:28.216483 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcf827-8267-40e4-b371-8437e0396d2a None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:28.216483 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcf827-8267-40e4-b371-8437e0396d2a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:28.216986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcf827-8267-40e4-b371-8437e0396d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:28.319916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-6ffcf827-8267-40e4-b371-8437e0396d2a None None] MFA Rules not processed for user `a99a2ba62f3948e99f6e78cabade3685`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:28.321268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6ffcf827-8267-40e4-b371-8437e0396d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:28.436843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:28.643246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 837/1672] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:28.660438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e07b1-106b-4d2b-99cd-a27740962545 service swift] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:28.662278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b38e07b1-106b-4d2b-99cd-a27740962545 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:28.781960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:28.810211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcf827-8267-40e4-b371-8437e0396d2a None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:28.812157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6ffcf827-8267-40e4-b371-8437e0396d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:28.947524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcf827-8267-40e4-b371-8437e0396d2a None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:28.953323 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:28.955301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:28.955832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:28.956357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] PATH_INFO: `/v3/projects/f867eb27e4f64a2aba64d0faefe36b41` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:28.958469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f867eb27e4f64a2aba64d0faefe36b41)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:28.961603 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:29.014030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e07b1-106b-4d2b-99cd-a27740962545 service swift] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:29.023591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a23d3-68a7-4db3-b9d8-ec5c38ae95d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:29.025999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a23d3-68a7-4db3-b9d8-ec5c38ae95d0 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:29.026527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a23d3-68a7-4db3-b9d8-ec5c38ae95d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:29.027074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a23d3-68a7-4db3-b9d8-ec5c38ae95d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:29.040473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a23d3-68a7-4db3-b9d8-ec5c38ae95d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:29.042493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a23d3-68a7-4db3-b9d8-ec5c38ae95d0 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:29.208791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 836/1673] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:29.443196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f867eb27e4f64a2aba64d0faefe36b41', 'request_id': 'req-0af170c8-94b9-4160-93c0-6eb0823a09ce'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:29.471749 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f867eb27e4f64a2aba64d0faefe36b41', 'request_id': 'req-0af170c8-94b9-4160-93c0-6eb0823a09ce'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:29.623750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f867eb27e4f64a2aba64d0faefe36b41', 'request_id': 'req-0af170c8-94b9-4160-93c0-6eb0823a09ce'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:29.665927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] The token cache is being invalidate because project f867eb27e4f64a2aba64d0faefe36b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:29.665927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:29.665927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0af170c8-94b9-4160-93c0-6eb0823a09ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:29.671967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 838/1674] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:28 2022] DELETE /identity/v3/projects/f867eb27e4f64a2aba64d0faefe36b41 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:29.677038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a23d3-68a7-4db3-b9d8-ec5c38ae95d0 service nova] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:29.693474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a23d3-68a7-4db3-b9d8-ec5c38ae95d0 service nova] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:29.717082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553bbc6-995b-436c-934e-82ae511a901a None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:29.717331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553bbc6-995b-436c-934e-82ae511a901a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:29.717731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553bbc6-995b-436c-934e-82ae511a901a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:29.822091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-c553bbc6-995b-436c-934e-82ae511a901a None None] MFA Rules not processed for user `5c3f539d6d374fd8b3eaa9e3e22e5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:29.828825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c553bbc6-995b-436c-934e-82ae511a901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:29.882717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:29.883679 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:29.884049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:29.884904 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] PATH_INFO: `/v3/users/59fb750e776b42ffbd7547baee2064a5` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:29.886706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fb750e776b42ffbd7547baee2064a5)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:29.889220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:30.011934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 839/1675] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:30.017744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3b192-0907-4bef-b984-69d054cb0525 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:30.018102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3b192-0907-4bef-b984-69d054cb0525 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:30.018391 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3b192-0907-4bef-b984-69d054cb0525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:30.064489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:30.077794 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d8e3b192-0907-4bef-b984-69d054cb0525 None None] MFA Rules not processed for user `5c3f539d6d374fd8b3eaa9e3e22e5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:30.084491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d8e3b192-0907-4bef-b984-69d054cb0525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:30.110303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 840/1676] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:30.116132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3b192-0907-4bef-b984-69d054cb0525 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:30.120717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d8e3b192-0907-4bef-b984-69d054cb0525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:30.150193 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fb750e776b42ffbd7547baee2064a5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:30.225397 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fb750e776b42ffbd7547baee2064a5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:30.238911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3b192-0907-4bef-b984-69d054cb0525 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:30.246848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf7754-a71b-4fcd-b82c-7eeb5a057bb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:30.248156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf7754-a71b-4fcd-b82c-7eeb5a057bb6 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:30.248629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf7754-a71b-4fcd-b82c-7eeb5a057bb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:30.249000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf7754-a71b-4fcd-b82c-7eeb5a057bb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:30.263210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf7754-a71b-4fcd-b82c-7eeb5a057bb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:30.268419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf7754-a71b-4fcd-b82c-7eeb5a057bb6 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:30.273041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fb750e776b42ffbd7547baee2064a5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:30.273902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fb750e776b42ffbd7547baee2064a5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:30.282925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 841/1677] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:20:30.286995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fb750e776b42ffbd7547baee2064a5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:30.326968 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 837/1678] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:29 2022] DELETE /identity/v3/users/59fb750e776b42ffbd7547baee2064a5 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:30.594326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d07fc-c560-4ce7-9231-6dc65d8824f9 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:30.594326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d07fc-c560-4ce7-9231-6dc65d8824f9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:30.594759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d07fc-c560-4ce7-9231-6dc65d8824f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:30.666954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-e72d07fc-c560-4ce7-9231-6dc65d8824f9 None None] MFA Rules not processed for user `37a7776277ca42eba4476242438fbf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:30.674297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e72d07fc-c560-4ce7-9231-6dc65d8824f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:30.850907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 842/1679] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:30.871652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:30.878752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:30.973824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d07fc-c560-4ce7-9231-6dc65d8824f9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:30.975527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e72d07fc-c560-4ce7-9231-6dc65d8824f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:30.983335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:31.096172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9f45c-f2dd-4234-9fee-e23867eafa83 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:31.107422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9b191-d2f9-46c5-83f7-08e97764c121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:31.108381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b191-d2f9-46c5-83f7-08e97764c121 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:31.108779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b191-d2f9-46c5-83f7-08e97764c121 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:31.109168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b191-d2f9-46c5-83f7-08e97764c121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:31.130475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9b191-d2f9-46c5-83f7-08e97764c121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:31.132456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9b191-d2f9-46c5-83f7-08e97764c121 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:31.153527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 838/1680] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:31.232434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d07fc-c560-4ce7-9231-6dc65d8824f9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:31.241991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:31.243020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:31.243402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:31.243777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] PATH_INFO: `/v3/projects/d7216eb3e53b48d495f1194f4c721ce9` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:31.245455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7216eb3e53b48d495f1194f4c721ce9)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:31.247196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:31.410476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7216eb3e53b48d495f1194f4c721ce9', 'request_id': 'req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:31.437708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7216eb3e53b48d495f1194f4c721ce9', 'request_id': 'req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:31.540091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7216eb3e53b48d495f1194f4c721ce9', 'request_id': 'req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:31.556943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] The token cache is being invalidate because project d7216eb3e53b48d495f1194f4c721ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:31.557281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:31.557921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7eb3a514-c5f5-4f56-be73-f5935d23f3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:31.561962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 843/1681] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:30 2022] DELETE /identity/v3/projects/d7216eb3e53b48d495f1194f4c721ce9 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:20:31.567469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780387b2-099b-4e84-82a4-ffe7915b2bb2 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:31.567762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780387b2-099b-4e84-82a4-ffe7915b2bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:31.568166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780387b2-099b-4e84-82a4-ffe7915b2bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:31.590674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-780387b2-099b-4e84-82a4-ffe7915b2bb2 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:31.592351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-780387b2-099b-4e84-82a4-ffe7915b2bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:31.766175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 839/1682] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:31.770862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3858544-7ede-49c3-bbd6-fa4b24338a96 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:31.772533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3858544-7ede-49c3-bbd6-fa4b24338a96 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:31.772533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3858544-7ede-49c3-bbd6-fa4b24338a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:31.846726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a3858544-7ede-49c3-bbd6-fa4b24338a96 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:31.854917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a3858544-7ede-49c3-bbd6-fa4b24338a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:31.879725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 844/1683] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:31.885295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780387b2-099b-4e84-82a4-ffe7915b2bb2 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:31.901415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780387b2-099b-4e84-82a4-ffe7915b2bb2 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:31.938928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea576dc-5200-4680-8681-28a8ec488b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:31.947935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea576dc-5200-4680-8681-28a8ec488b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:31.948298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea576dc-5200-4680-8681-28a8ec488b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:31.948586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea576dc-5200-4680-8681-28a8ec488b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:31.951521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea576dc-5200-4680-8681-28a8ec488b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:31.953474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea576dc-5200-4680-8681-28a8ec488b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:31.961456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea576dc-5200-4680-8681-28a8ec488b5b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:32.019582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 840/1684] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:32.024773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3858544-7ede-49c3-bbd6-fa4b24338a96 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:32.039101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3858544-7ede-49c3-bbd6-fa4b24338a96 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:32.053882 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ebed1-ef58-4e5c-bf53-117cb15c58ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:32.064611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ebed1-ef58-4e5c-bf53-117cb15c58ee admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:32.064611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ebed1-ef58-4e5c-bf53-117cb15c58ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:32.064611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ebed1-ef58-4e5c-bf53-117cb15c58ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:32.064611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ebed1-ef58-4e5c-bf53-117cb15c58ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:32.064611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ebed1-ef58-4e5c-bf53-117cb15c58ee admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:32.081488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:32.127466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917790d-ea31-4ab5-b09d-cab017727172 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:32.127829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917790d-ea31-4ab5-b09d-cab017727172 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:32.128145 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917790d-ea31-4ab5-b09d-cab017727172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:32.193019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-6917790d-ea31-4ab5-b09d-cab017727172 None None] MFA Rules not processed for user `5c3f539d6d374fd8b3eaa9e3e22e5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:32.200554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 845/1685] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:32 2022] POST /identity/v3/projects => generated 363 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:32.201113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9dd5f-9fd0-468f-868e-273a355024ee None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:32.201419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9dd5f-9fd0-468f-868e-273a355024ee None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:32.201710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9dd5f-9fd0-468f-868e-273a355024ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:32.207462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6917790d-ea31-4ab5-b09d-cab017727172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:32.289535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a3a9dd5f-9fd0-468f-868e-273a355024ee None None] MFA Rules not processed for user `ae7551e9626541d49a1be9330094f42e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:32.291252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a3a9dd5f-9fd0-468f-868e-273a355024ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:32.462410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 841/1686] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:32.463428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917790d-ea31-4ab5-b09d-cab017727172 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:32.517319 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 846/1687] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Jun 2 13:20:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:32.648810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917790d-ea31-4ab5-b09d-cab017727172 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:32.653601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9dd5f-9fd0-468f-868e-273a355024ee None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:32.656001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a3a9dd5f-9fd0-468f-868e-273a355024ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:32.657191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb2053-5046-4c26-92be-c27b26730988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:32.661062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2053-5046-4c26-92be-c27b26730988 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:32.661062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2053-5046-4c26-92be-c27b26730988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:32.661062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb2053-5046-4c26-92be-c27b26730988 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:32.661062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb2053-5046-4c26-92be-c27b26730988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:32.665538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb2053-5046-4c26-92be-c27b26730988 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:32.683989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9dd5f-9fd0-468f-868e-273a355024ee None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:32.689144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7768a2-d449-4e16-ad07-97249b5ee918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:32.706585 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7768a2-d449-4e16-ad07-97249b5ee918 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:32.707676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7768a2-d449-4e16-ad07-97249b5ee918 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:32.708265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7768a2-d449-4e16-ad07-97249b5ee918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:32.724406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7768a2-d449-4e16-ad07-97249b5ee918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:32.731176 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7768a2-d449-4e16-ad07-97249b5ee918 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:32.761703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 847/1688] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:20:32.825037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 842/1689] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:32 2022] POST /identity/v3/users => generated 282 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:32.825473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7768a2-d449-4e16-ad07-97249b5ee918 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:32.855736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7768a2-d449-4e16-ad07-97249b5ee918 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:32.873784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6ff14-9caa-435a-9bf3-4257a03db836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:32.877241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ff14-9caa-435a-9bf3-4257a03db836 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:32.877241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ff14-9caa-435a-9bf3-4257a03db836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:32.877241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ff14-9caa-435a-9bf3-4257a03db836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:32.877241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6ff14-9caa-435a-9bf3-4257a03db836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:32.879946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6ff14-9caa-435a-9bf3-4257a03db836 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:32.921500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 848/1690] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:32.923121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb2053-5046-4c26-92be-c27b26730988 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:32.940067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:32.946621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb2053-5046-4c26-92be-c27b26730988 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:32.964422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1716e-78fd-4de4-a4e9-2508112a032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:32.964422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1716e-78fd-4de4-a4e9-2508112a032b admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:32.964422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1716e-78fd-4de4-a4e9-2508112a032b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:32.979389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1716e-78fd-4de4-a4e9-2508112a032b admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:32.980331 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1716e-78fd-4de4-a4e9-2508112a032b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:32.986023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1716e-78fd-4de4-a4e9-2508112a032b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:33.044990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 843/1691] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:33.048191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6ff14-9caa-435a-9bf3-4257a03db836 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:33.067052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6ff14-9caa-435a-9bf3-4257a03db836 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:33.080057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35074756-e0b1-452a-8a01-90f2482bdee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:33.082602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35074756-e0b1-452a-8a01-90f2482bdee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:33.082602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35074756-e0b1-452a-8a01-90f2482bdee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:33.083566 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35074756-e0b1-452a-8a01-90f2482bdee4 admin admin] PATH_INFO: `/v3/projects/67c517142fb84167a22fd35e65af3cf9/users/1d38940a67b44e80805583e9a71d586f/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:33.134435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35074756-e0b1-452a-8a01-90f2482bdee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c517142fb84167a22fd35e65af3cf9, user_id=1d38940a67b44e80805583e9a71d586f, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:33.149210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35074756-e0b1-452a-8a01-90f2482bdee4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:33.317366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 849/1692] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:33 2022] PUT /identity/v3/projects/67c517142fb84167a22fd35e65af3cf9/users/1d38940a67b44e80805583e9a71d586f/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:33.320444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228526d4-0c5f-4f2f-b285-b6d36430769b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:33.320741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228526d4-0c5f-4f2f-b285-b6d36430769b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:33.321028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228526d4-0c5f-4f2f-b285-b6d36430769b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:33.462961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-228526d4-0c5f-4f2f-b285-b6d36430769b None None] MFA Rules not processed for user `1d38940a67b44e80805583e9a71d586f`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:33.466144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-228526d4-0c5f-4f2f-b285-b6d36430769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:33.791386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 844/1693] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:33.797346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35074756-e0b1-452a-8a01-90f2482bdee4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:33.863005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:34.052622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35074756-e0b1-452a-8a01-90f2482bdee4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:34.091721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558fce-8f7d-44be-b577-5f6712d427e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:34.092664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558fce-8f7d-44be-b577-5f6712d427e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:34.095434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558fce-8f7d-44be-b577-5f6712d427e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:34.095720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558fce-8f7d-44be-b577-5f6712d427e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:34.096536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558fce-8f7d-44be-b577-5f6712d427e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:34.111618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558fce-8f7d-44be-b577-5f6712d427e2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:34.273965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 850/1694] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:33 2022] POST /identity/v3/projects => generated 365 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:34.278101 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228526d4-0c5f-4f2f-b285-b6d36430769b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:34.311986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228526d4-0c5f-4f2f-b285-b6d36430769b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:34.430369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c03af6-dc36-441f-9919-487867d9d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:34.437073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c03af6-dc36-441f-9919-487867d9d51d admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:34.437073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c03af6-dc36-441f-9919-487867d9d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:34.437073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c03af6-dc36-441f-9919-487867d9d51d admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:34.437073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c03af6-dc36-441f-9919-487867d9d51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:34.437073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c03af6-dc36-441f-9919-487867d9d51d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:34.571312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 845/1695] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:34 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:34.576567 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558fce-8f7d-44be-b577-5f6712d427e2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:34.590820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558fce-8f7d-44be-b577-5f6712d427e2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:34.597790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a82a-23ae-42ac-8241-9cce5729a220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:34.599136 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a82a-23ae-42ac-8241-9cce5729a220 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:34.600112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a82a-23ae-42ac-8241-9cce5729a220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:34.600574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5a82a-23ae-42ac-8241-9cce5729a220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:34.601706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5a82a-23ae-42ac-8241-9cce5729a220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:34.603945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5a82a-23ae-42ac-8241-9cce5729a220 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:34.625981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 851/1696] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:20:34.628540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c03af6-dc36-441f-9919-487867d9d51d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:34.652519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c03af6-dc36-441f-9919-487867d9d51d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:34.658830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba1cbf-b557-4d0f-8664-441cd09a49eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:34.660389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba1cbf-b557-4d0f-8664-441cd09a49eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:34.660891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba1cbf-b557-4d0f-8664-441cd09a49eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:34.664795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba1cbf-b557-4d0f-8664-441cd09a49eb admin admin] PATH_INFO: `/v3/projects/10908edd994448dbaa34920d9355c759/users/21deb2a6d17f490aa019e66238371f0c/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:34.712116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba1cbf-b557-4d0f-8664-441cd09a49eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=10908edd994448dbaa34920d9355c759, user_id=21deb2a6d17f490aa019e66238371f0c, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:34.717889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba1cbf-b557-4d0f-8664-441cd09a49eb admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:34.858606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 846/1697] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:34 2022] PUT /identity/v3/projects/10908edd994448dbaa34920d9355c759/users/21deb2a6d17f490aa019e66238371f0c/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:34.859408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a82a-23ae-42ac-8241-9cce5729a220 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:34.874187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5a82a-23ae-42ac-8241-9cce5729a220 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:35.057048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7916b-0d66-448d-820d-b47131f49ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:35.057812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7916b-0d66-448d-820d-b47131f49ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:35.058104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7916b-0d66-448d-820d-b47131f49ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:35.058385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7916b-0d66-448d-820d-b47131f49ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:35.060326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7916b-0d66-448d-820d-b47131f49ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:35.062017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7916b-0d66-448d-820d-b47131f49ec5 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:35.099355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 852/1698] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:35.103362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba1cbf-b557-4d0f-8664-441cd09a49eb admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:35.121381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba1cbf-b557-4d0f-8664-441cd09a49eb admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:35.127176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56f6cd-5bce-499b-95c1-9a9c742fe0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:35.128531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56f6cd-5bce-499b-95c1-9a9c742fe0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:35.129058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56f6cd-5bce-499b-95c1-9a9c742fe0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:35.129590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56f6cd-5bce-499b-95c1-9a9c742fe0e6 admin admin] PATH_INFO: `/v3/projects/10908edd994448dbaa34920d9355c759/users/21deb2a6d17f490aa019e66238371f0c/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:35.133964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56f6cd-5bce-499b-95c1-9a9c742fe0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10908edd994448dbaa34920d9355c759, user_id=21deb2a6d17f490aa019e66238371f0c, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:35.141294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56f6cd-5bce-499b-95c1-9a9c742fe0e6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:35.171284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 847/1699] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:35 2022] PUT /identity/v3/projects/10908edd994448dbaa34920d9355c759/users/21deb2a6d17f490aa019e66238371f0c/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:35.182314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf673-ba66-4679-84f3-04be881f0269 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:35.182661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf673-ba66-4679-84f3-04be881f0269 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:35.182950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf673-ba66-4679-84f3-04be881f0269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:35.252621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-1c6bf673-ba66-4679-84f3-04be881f0269 None None] MFA Rules not processed for user `21deb2a6d17f490aa019e66238371f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:35.253891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1c6bf673-ba66-4679-84f3-04be881f0269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:35.464492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 853/1700] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:35.487731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56f6cd-5bce-499b-95c1-9a9c742fe0e6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:35.492627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bf56f6cd-5bce-499b-95c1-9a9c742fe0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:35.497816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:35.702372 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56f6cd-5bce-499b-95c1-9a9c742fe0e6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:35.706452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169fba2-c484-4f2b-b91c-da2881ff3199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:35.708025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169fba2-c484-4f2b-b91c-da2881ff3199 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:35.708326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169fba2-c484-4f2b-b91c-da2881ff3199 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:35.711328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169fba2-c484-4f2b-b91c-da2881ff3199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:35.726099 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169fba2-c484-4f2b-b91c-da2881ff3199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:35.728707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169fba2-c484-4f2b-b91c-da2881ff3199 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:35.744390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 848/1701] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:36.329204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0329-4483-48ad-b894-0ba8d69cc7a2 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:36.329736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0329-4483-48ad-b894-0ba8d69cc7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:36.329823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff0329-4483-48ad-b894-0ba8d69cc7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:36.372629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-94ff0329-4483-48ad-b894-0ba8d69cc7a2 None None] MFA Rules not processed for user `a99a2ba62f3948e99f6e78cabade3685`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:36.373862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-94ff0329-4483-48ad-b894-0ba8d69cc7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:36.383549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:36.471760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 854/1702] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:36.553205 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c50b7-515a-4942-a3d4-20f23309dcf5 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:36.553829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c50b7-515a-4942-a3d4-20f23309dcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:36.553954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c50b7-515a-4942-a3d4-20f23309dcf5 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:36.555457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 849/1703] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:36.569274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724433b-1a66-446e-963d-2011f1ecd040 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:36.570902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724433b-1a66-446e-963d-2011f1ecd040 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:36.571188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724433b-1a66-446e-963d-2011f1ecd040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:36.603650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d724433b-1a66-446e-963d-2011f1ecd040 None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:36.609674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d724433b-1a66-446e-963d-2011f1ecd040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:36.872718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 855/1704] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:37.539659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9513dd-727f-4c92-b209-05ad2d1641bc None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:37.539981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9513dd-727f-4c92-b209-05ad2d1641bc None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:37.540426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9513dd-727f-4c92-b209-05ad2d1641bc None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:37.542120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 850/1705] 10.222.0.46 () {54 vars in 912 bytes} [Thu Jun 2 13:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:37.554033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d74e-5629-46e1-b304-78cd95bd6daa None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:37.554602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d74e-5629-46e1-b304-78cd95bd6daa None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:37.554602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d74e-5629-46e1-b304-78cd95bd6daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:37.570388 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9513dd-727f-4c92-b209-05ad2d1641bc None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:37.624814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3eb9d74e-5629-46e1-b304-78cd95bd6daa None None] MFA Rules not processed for user `ae7551e9626541d49a1be9330094f42e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:37.628122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3eb9d74e-5629-46e1-b304-78cd95bd6daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:37.759742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9513dd-727f-4c92-b209-05ad2d1641bc None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:37.773654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:37.774646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:37.774929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:37.775366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] PATH_INFO: `/v3/users/1d38940a67b44e80805583e9a71d586f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:37.778957 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d38940a67b44e80805583e9a71d586f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:37.784259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:37.790208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 856/1706] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:20:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:37.804529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9d74e-5629-46e1-b304-78cd95bd6daa None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:37.806699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3eb9d74e-5629-46e1-b304-78cd95bd6daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:37.823643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9d74e-5629-46e1-b304-78cd95bd6daa None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:37.831474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add24b9-4b88-4d37-84ab-21a816299bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:37.831474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add24b9-4b88-4d37-84ab-21a816299bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:37.831474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add24b9-4b88-4d37-84ab-21a816299bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:37.831474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add24b9-4b88-4d37-84ab-21a816299bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:37.844746 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add24b9-4b88-4d37-84ab-21a816299bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:37.848706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add24b9-4b88-4d37-84ab-21a816299bf9 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:37.869812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 857/1707] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:38.072963 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add24b9-4b88-4d37-84ab-21a816299bf9 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:38.074184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6add24b9-4b88-4d37-84ab-21a816299bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:38.126603 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add24b9-4b88-4d37-84ab-21a816299bf9 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:38.131799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d38940a67b44e80805583e9a71d586f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:38.161577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56c0f-d524-4b13-928d-8e7a54fa7d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:38.162864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56c0f-d524-4b13-928d-8e7a54fa7d78 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:38.163147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56c0f-d524-4b13-928d-8e7a54fa7d78 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:38.163665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56c0f-d524-4b13-928d-8e7a54fa7d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:38.197945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c56c0f-d524-4b13-928d-8e7a54fa7d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:38.208507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c56c0f-d524-4b13-928d-8e7a54fa7d78 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:38.253998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d38940a67b44e80805583e9a71d586f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:38.295601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 858/1708] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:38.303928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d38940a67b44e80805583e9a71d586f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:38.310586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d38940a67b44e80805583e9a71d586f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:38.340572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d38940a67b44e80805583e9a71d586f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:38.368058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 851/1709] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:37 2022] DELETE /identity/v3/users/1d38940a67b44e80805583e9a71d586f => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:38.371127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aefad7-fa3b-487e-a4d0-4623a18fa757 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:38.371584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aefad7-fa3b-487e-a4d0-4623a18fa757 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:38.372093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aefad7-fa3b-487e-a4d0-4623a18fa757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:38.479050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-38aefad7-fa3b-487e-a4d0-4623a18fa757 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:38.481827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-38aefad7-fa3b-487e-a4d0-4623a18fa757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:38.739548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:38.891284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 859/1710] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:38.902156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:38.906255 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:39.014409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:39.115905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26adb06-7738-476b-9921-b0bea35a1afc admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:39.122859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b17f2-aa1e-4e02-93a0-6c6dec3a422e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:39.122859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b17f2-aa1e-4e02-93a0-6c6dec3a422e service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:39.122859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b17f2-aa1e-4e02-93a0-6c6dec3a422e service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:39.122859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b17f2-aa1e-4e02-93a0-6c6dec3a422e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:39.136358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b17f2-aa1e-4e02-93a0-6c6dec3a422e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:39.137932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b17f2-aa1e-4e02-93a0-6c6dec3a422e service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:39.151842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 852/1711] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:39.647459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aefad7-fa3b-487e-a4d0-4623a18fa757 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:39.650772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-38aefad7-fa3b-487e-a4d0-4623a18fa757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:39.699938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aefad7-fa3b-487e-a4d0-4623a18fa757 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:39.715059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:39.717319 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:39.720087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:39.721943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] PATH_INFO: `/v3/users/343b4d48405447f69393092d7b29fb82` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:39.734235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343b4d48405447f69393092d7b29fb82)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:39.737723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:39.945065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820769-c82c-4e2d-a071-44fc8da77a4a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:39.945768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820769-c82c-4e2d-a071-44fc8da77a4a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:39.945768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df820769-c82c-4e2d-a071-44fc8da77a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:39.987396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-df820769-c82c-4e2d-a071-44fc8da77a4a None None] MFA Rules not processed for user `37a7776277ca42eba4476242438fbf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:39.989011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-df820769-c82c-4e2d-a071-44fc8da77a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:40.051819 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343b4d48405447f69393092d7b29fb82'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:40.140797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343b4d48405447f69393092d7b29fb82'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:40.162120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 853/1712] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:40.178688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343b4d48405447f69393092d7b29fb82'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:40.180682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343b4d48405447f69393092d7b29fb82'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:40.206048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343b4d48405447f69393092d7b29fb82'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:40.214732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 860/1713] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:39 2022] DELETE /identity/v3/users/343b4d48405447f69393092d7b29fb82 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:40.220131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fca8a-7c93-4508-a68d-cddf9d9d88dc None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:40.220834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fca8a-7c93-4508-a68d-cddf9d9d88dc None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:40.223976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fca8a-7c93-4508-a68d-cddf9d9d88dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:40.246908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d17fca8a-7c93-4508-a68d-cddf9d9d88dc None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:40.248578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d17fca8a-7c93-4508-a68d-cddf9d9d88dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:40.297938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:40.300112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:40.395232 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 854/1714] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:40.440950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f9b0b-cd68-4669-88e5-80b5c17b8d83 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:40.447306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:40.448341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:40.448731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:40.449369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] PATH_INFO: `/v3/projects/67c517142fb84167a22fd35e65af3cf9` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:40.450684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c517142fb84167a22fd35e65af3cf9)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:40.453015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:40.477893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fca8a-7c93-4508-a68d-cddf9d9d88dc None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:40.480151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d17fca8a-7c93-4508-a68d-cddf9d9d88dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:40.692780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:40.703460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fca8a-7c93-4508-a68d-cddf9d9d88dc None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:40.716121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c517142fb84167a22fd35e65af3cf9', 'request_id': 'req-17c9ac80-d0d2-4009-9a17-462d472bfe3e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:40.741005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c517142fb84167a22fd35e65af3cf9', 'request_id': 'req-17c9ac80-d0d2-4009-9a17-462d472bfe3e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:40.765183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:40.805266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f820d7-d5f6-4f90-b95a-cdfa11383470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:40.805942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f820d7-d5f6-4f90-b95a-cdfa11383470 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:40.806230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f820d7-d5f6-4f90-b95a-cdfa11383470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:40.806506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f820d7-d5f6-4f90-b95a-cdfa11383470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:40.886702 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c517142fb84167a22fd35e65af3cf9', 'request_id': 'req-17c9ac80-d0d2-4009-9a17-462d472bfe3e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:40.905157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] The token cache is being invalidate because project 67c517142fb84167a22fd35e65af3cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:40.905665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:40.909561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:40.913491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 861/1715] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:40 2022] DELETE /identity/v3/projects/67c517142fb84167a22fd35e65af3cf9 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:40.917228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:40.920515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:41.019921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f820d7-d5f6-4f90-b95a-cdfa11383470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:41.023157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f820d7-d5f6-4f90-b95a-cdfa11383470 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:41.035905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9ac80-d0d2-4009-9a17-462d472bfe3e admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:41.042351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:41.042711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:41.042981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:41.043298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] PATH_INFO: `/v3/users/21deb2a6d17f490aa019e66238371f0c` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:41.044572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=21deb2a6d17f490aa019e66238371f0c)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:41.046588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:41.057610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 855/1716] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:20:41.385381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21deb2a6d17f490aa019e66238371f0c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:41.485484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21deb2a6d17f490aa019e66238371f0c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:41.506079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21deb2a6d17f490aa019e66238371f0c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:41.507119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21deb2a6d17f490aa019e66238371f0c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:41.530202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-64add9f2-f6ea-4706-9788-29bc15d0e28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21deb2a6d17f490aa019e66238371f0c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:41.548283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 862/1717] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:40 2022] DELETE /identity/v3/users/21deb2a6d17f490aa019e66238371f0c => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:20:41.972014 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f820d7-d5f6-4f90-b95a-cdfa11383470 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:41.973899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-76f820d7-d5f6-4f90-b95a-cdfa11383470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:42.010697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f820d7-d5f6-4f90-b95a-cdfa11383470 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:42.162428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:42.163295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:42.163295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:42.163516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] PATH_INFO: `/v3/users/083c1823c3e341cc8f9ae835e41b24bf` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:42.167695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=083c1823c3e341cc8f9ae835e41b24bf)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:42.170108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:42.538574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083c1823c3e341cc8f9ae835e41b24bf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:42.616819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083c1823c3e341cc8f9ae835e41b24bf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:42.644519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083c1823c3e341cc8f9ae835e41b24bf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:42.649100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083c1823c3e341cc8f9ae835e41b24bf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:42.679522 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083c1823c3e341cc8f9ae835e41b24bf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:42.684188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:42.699155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 856/1718] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:41 2022] DELETE /identity/v3/users/083c1823c3e341cc8f9ae835e41b24bf => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:42.703663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7727d-c060-4dbe-876c-337afc47b5a7 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:42.704312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7727d-c060-4dbe-876c-337afc47b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:42.704393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7727d-c060-4dbe-876c-337afc47b5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:42.728246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-08d7727d-c060-4dbe-876c-337afc47b5a7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:42.730013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-08d7727d-c060-4dbe-876c-337afc47b5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:42.814452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:42.842857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 863/1719] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:42.887247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:42.888676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:42.993821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b7aca-9f21-49f2-8f96-6e376992d1cd admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:42.997778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37d339-9168-4d72-901c-eedbaf59c4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:42.998452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d339-9168-4d72-901c-eedbaf59c4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:42.998741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d339-9168-4d72-901c-eedbaf59c4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:42.999022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d339-9168-4d72-901c-eedbaf59c4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:43.023605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37d339-9168-4d72-901c-eedbaf59c4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:43.025474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37d339-9168-4d72-901c-eedbaf59c4e2 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:43.063312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 857/1720] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:43.731532 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7727d-c060-4dbe-876c-337afc47b5a7 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:43.733293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-08d7727d-c060-4dbe-876c-337afc47b5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:43.751831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7727d-c060-4dbe-876c-337afc47b5a7 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:43.758135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:43.759447 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:43.759822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:43.761929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] PATH_INFO: `/v3/projects/10908edd994448dbaa34920d9355c759` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:43.764740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10908edd994448dbaa34920d9355c759)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:43.804016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:43.805360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37d339-9168-4d72-901c-eedbaf59c4e2 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:43.805360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cc37d339-9168-4d72-901c-eedbaf59c4e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:43.879010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37d339-9168-4d72-901c-eedbaf59c4e2 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:43.895959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:43.899558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:43.899983 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:43.900347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] PATH_INFO: `/v3/projects/6cf137da41884a70b893f5214753fa82` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:43.904173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf137da41884a70b893f5214753fa82)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:43.905739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: WARNING py.warnings [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:20:43.905739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: warnings.warn(msg) Jun 02 13:20:43.905739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: Jun 02 13:20:43.908190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:45.126592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10908edd994448dbaa34920d9355c759', 'request_id': 'req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.133595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10908edd994448dbaa34920d9355c759', 'request_id': 'req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.223771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf137da41884a70b893f5214753fa82', 'request_id': 'req-7a4bdd14-c70d-44d4-afdc-641cfea56901'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.236817 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf137da41884a70b893f5214753fa82', 'request_id': 'req-7a4bdd14-c70d-44d4-afdc-641cfea56901'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.384455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10908edd994448dbaa34920d9355c759', 'request_id': 'req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.410937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] The token cache is being invalidate because project 10908edd994448dbaa34920d9355c759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:45.411353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.412913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.416270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 864/1721] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:43 2022] DELETE /identity/v3/projects/10908edd994448dbaa34920d9355c759 => generated 0 bytes in 1685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:45.417867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:45.418951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:45.544165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf137da41884a70b893f5214753fa82', 'request_id': 'req-7a4bdd14-c70d-44d4-afdc-641cfea56901'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.563017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] The token cache is being invalidate because project 6cf137da41884a70b893f5214753fa82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:45.563543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.564528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a4bdd14-c70d-44d4-afdc-641cfea56901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.566567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 858/1722] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:43 2022] DELETE /identity/v3/projects/6cf137da41884a70b893f5214753fa82 => generated 0 bytes in 1769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:45.568965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21841e-f4ac-4a76-ab8a-3179374aba05 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:45.569823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21841e-f4ac-4a76-ab8a-3179374aba05 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:45.570261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21841e-f4ac-4a76-ab8a-3179374aba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:45.575421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4d08-5d40-4bd7-9f50-9dfd8a7afe1a admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:45.596929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-bf21841e-f4ac-4a76-ab8a-3179374aba05 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:45.598514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bf21841e-f4ac-4a76-ab8a-3179374aba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:45.699573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:45.701018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:45.701449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:45.701948 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] PATH_INFO: `/v3/projects/909dabee4fb14021b27059beaae9a896` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:45.704850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=909dabee4fb14021b27059beaae9a896)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:45.710008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:45.759910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 859/1723] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:45.760132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e167a-91c9-4218-b066-6fcfe1759e3d None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:45.760593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e167a-91c9-4218-b066-6fcfe1759e3d None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:45.760863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e167a-91c9-4218-b066-6fcfe1759e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:45.802143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-446e167a-91c9-4218-b066-6fcfe1759e3d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:45.804532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-446e167a-91c9-4218-b066-6fcfe1759e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:45.812991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 860/1724] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:45.814479 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb8a4-c216-44ea-8c82-6e9b90bbce4b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:45.814781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb8a4-c216-44ea-8c82-6e9b90bbce4b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:45.815100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb8a4-c216-44ea-8c82-6e9b90bbce4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:45.834873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a0fcb8a4-c216-44ea-8c82-6e9b90bbce4b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:45.836621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a0fcb8a4-c216-44ea-8c82-6e9b90bbce4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:45.845592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 861/1725] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:45.847029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490eeed-c7ef-443a-aaba-8271cffa322b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:45.847329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490eeed-c7ef-443a-aaba-8271cffa322b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:45.847652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490eeed-c7ef-443a-aaba-8271cffa322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:45.893029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-1490eeed-c7ef-443a-aaba-8271cffa322b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:45.894259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1490eeed-c7ef-443a-aaba-8271cffa322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:45.920187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 862/1726] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:45.921159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490eeed-c7ef-443a-aaba-8271cffa322b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:45.933594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909dabee4fb14021b27059beaae9a896', 'request_id': 'req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:45.940616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490eeed-c7ef-443a-aaba-8271cffa322b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:45.943728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909dabee4fb14021b27059beaae9a896', 'request_id': 'req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:46.008217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f73687-4961-4e17-bf27-43c7b73a4bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.008885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f73687-4961-4e17-bf27-43c7b73a4bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.009168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f73687-4961-4e17-bf27-43c7b73a4bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.009444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f73687-4961-4e17-bf27-43c7b73a4bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.010165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f73687-4961-4e17-bf27-43c7b73a4bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:46.010479 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f73687-4961-4e17-bf27-43c7b73a4bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.012083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f73687-4961-4e17-bf27-43c7b73a4bd9 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.023522 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 863/1727] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:46.024453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f73687-4961-4e17-bf27-43c7b73a4bd9 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.033670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f73687-4961-4e17-bf27-43c7b73a4bd9 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.038211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29dcc8-f37f-418b-a857-30f32447c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.038821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29dcc8-f37f-418b-a857-30f32447c0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.039104 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29dcc8-f37f-418b-a857-30f32447c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.039380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29dcc8-f37f-418b-a857-30f32447c0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.040095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29dcc8-f37f-418b-a857-30f32447c0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:46.040399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29dcc8-f37f-418b-a857-30f32447c0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.041930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29dcc8-f37f-418b-a857-30f32447c0c4 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.053780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 864/1728] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:46.054541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29dcc8-f37f-418b-a857-30f32447c0c4 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.061478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909dabee4fb14021b27059beaae9a896', 'request_id': 'req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:46.063467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29dcc8-f37f-418b-a857-30f32447c0c4 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.069040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a8f06-724d-498d-9b9f-4aa1071ea33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.073668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a8f06-724d-498d-9b9f-4aa1071ea33a admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.073668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a8f06-724d-498d-9b9f-4aa1071ea33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.073668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a8f06-724d-498d-9b9f-4aa1071ea33a admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.073668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a8f06-724d-498d-9b9f-4aa1071ea33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.073668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a8f06-724d-498d-9b9f-4aa1071ea33a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.074027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] The token cache is being invalidate because project 909dabee4fb14021b27059beaae9a896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:46.074027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:46.074653 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:46.076257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 865/1729] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:45 2022] DELETE /identity/v3/projects/909dabee4fb14021b27059beaae9a896 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:46.077006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.078347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:46.090493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b95a9b-f0d9-46bf-8eb6-1856f02738b6 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.095623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4531c-b7b6-42ba-9e48-373137b2968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.096337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4531c-b7b6-42ba-9e48-373137b2968b admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.096623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4531c-b7b6-42ba-9e48-373137b2968b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.096997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4531c-b7b6-42ba-9e48-373137b2968b admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.097699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4531c-b7b6-42ba-9e48-373137b2968b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.099793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4531c-b7b6-42ba-9e48-373137b2968b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.187186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 865/1730] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:46 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:46.188129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a8f06-724d-498d-9b9f-4aa1071ea33a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.192310 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b68a8f06-724d-498d-9b9f-4aa1071ea33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:46.217664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 866/1731] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:46 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:46.217664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4531c-b7b6-42ba-9e48-373137b2968b admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.220283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d6f4531c-b7b6-42ba-9e48-373137b2968b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:46.281423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a8f06-724d-498d-9b9f-4aa1071ea33a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.305614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4531c-b7b6-42ba-9e48-373137b2968b admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.329838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a7cc7-c4c1-4388-9e15-a44300e0affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.330553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7cc7-c4c1-4388-9e15-a44300e0affa admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.330840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7cc7-c4c1-4388-9e15-a44300e0affa admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.331142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a7cc7-c4c1-4388-9e15-a44300e0affa admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.331942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a7cc7-c4c1-4388-9e15-a44300e0affa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.333959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a7cc7-c4c1-4388-9e15-a44300e0affa admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.359275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.360393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.360740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.361366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] PATH_INFO: `/v3/users/4fb0e936ae9440c8bdf83f3cb8e0934d` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.362625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb0e936ae9440c8bdf83f3cb8e0934d)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.366668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.431815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 867/1732] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:46 2022] POST /identity/v3/users => generated 282 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:46.431815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a7cc7-c4c1-4388-9e15-a44300e0affa admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.441512 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a7cc7-c4c1-4388-9e15-a44300e0affa admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.454269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d970c2-8298-4f25-a54a-1ee9d57a4eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.455655 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d970c2-8298-4f25-a54a-1ee9d57a4eee admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.456100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d970c2-8298-4f25-a54a-1ee9d57a4eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.457028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d970c2-8298-4f25-a54a-1ee9d57a4eee admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.458134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d970c2-8298-4f25-a54a-1ee9d57a4eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.464608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d970c2-8298-4f25-a54a-1ee9d57a4eee admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.643308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 868/1733] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:46 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:46.643308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d970c2-8298-4f25-a54a-1ee9d57a4eee admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.651459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d970c2-8298-4f25-a54a-1ee9d57a4eee admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.657577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e2ed0-91be-47d0-a2e1-d5bd7079fb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.658430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e2ed0-91be-47d0-a2e1-d5bd7079fb9c admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.658804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e2ed0-91be-47d0-a2e1-d5bd7079fb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.659154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e2ed0-91be-47d0-a2e1-d5bd7079fb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.659994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e2ed0-91be-47d0-a2e1-d5bd7079fb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.663229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e2ed0-91be-47d0-a2e1-d5bd7079fb9c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.690404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 869/1734] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:46.695392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb0e936ae9440c8bdf83f3cb8e0934d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:46.696479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e2ed0-91be-47d0-a2e1-d5bd7079fb9c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.707509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e2ed0-91be-47d0-a2e1-d5bd7079fb9c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.723052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1711a-e667-46e6-a2df-3d0959b9047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.723999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1711a-e667-46e6-a2df-3d0959b9047b admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.724319 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1711a-e667-46e6-a2df-3d0959b9047b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.724658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1711a-e667-46e6-a2df-3d0959b9047b admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.725500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1711a-e667-46e6-a2df-3d0959b9047b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.727375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1711a-e667-46e6-a2df-3d0959b9047b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.742895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 870/1735] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:46.742895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1711a-e667-46e6-a2df-3d0959b9047b admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.753228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1711a-e667-46e6-a2df-3d0959b9047b admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.758643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcbc7e-cbd6-41ad-bdd6-e47dfaba7dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.765932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcbc7e-cbd6-41ad-bdd6-e47dfaba7dee admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.765932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcbc7e-cbd6-41ad-bdd6-e47dfaba7dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.765932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcbc7e-cbd6-41ad-bdd6-e47dfaba7dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.765932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcbc7e-cbd6-41ad-bdd6-e47dfaba7dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.765932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcbc7e-cbd6-41ad-bdd6-e47dfaba7dee admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.790711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:46.791283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 871/1736] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:46.792573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcbc7e-cbd6-41ad-bdd6-e47dfaba7dee admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.804078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcbc7e-cbd6-41ad-bdd6-e47dfaba7dee admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.809335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e125041-8a9a-4a5e-859c-03a365ad760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.810249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125041-8a9a-4a5e-859c-03a365ad760c admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.810743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125041-8a9a-4a5e-859c-03a365ad760c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.811220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125041-8a9a-4a5e-859c-03a365ad760c admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.812345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e125041-8a9a-4a5e-859c-03a365ad760c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.814232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e125041-8a9a-4a5e-859c-03a365ad760c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:46.821528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb0e936ae9440c8bdf83f3cb8e0934d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:46.830847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 872/1737] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:46.832103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e125041-8a9a-4a5e-859c-03a365ad760c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.864452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:46.873088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb0e936ae9440c8bdf83f3cb8e0934d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:46.873704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb0e936ae9440c8bdf83f3cb8e0934d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:46.898368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e125041-8a9a-4a5e-859c-03a365ad760c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:46.899675 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb0e936ae9440c8bdf83f3cb8e0934d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:46.908430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 866/1738] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:46 2022] DELETE /identity/v3/users/4fb0e936ae9440c8bdf83f3cb8e0934d => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:46.912842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:46.912842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:46.920820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9024ec-19ac-4b07-bad3-685013665cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:46.922308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9024ec-19ac-4b07-bad3-685013665cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:46.922896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9024ec-19ac-4b07-bad3-685013665cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:46.924445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9024ec-19ac-4b07-bad3-685013665cd5 admin admin] PATH_INFO: `/v3/projects/c21abb4b62f548d7b98d65c4706fca5f/users/e227e16aaad54e12972e81cba41cf169/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:46.955466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9024ec-19ac-4b07-bad3-685013665cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21abb4b62f548d7b98d65c4706fca5f, user_id=e227e16aaad54e12972e81cba41cf169, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:46.961716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9024ec-19ac-4b07-bad3-685013665cd5 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:47.024715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ca2ea-27e5-4a58-bd70-00be555820b5 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:47.030264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab177106-ed2a-45e6-9995-6e4274728b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:47.031292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177106-ed2a-45e6-9995-6e4274728b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:47.031764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177106-ed2a-45e6-9995-6e4274728b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:47.032816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177106-ed2a-45e6-9995-6e4274728b1f admin admin] PATH_INFO: `/v3/projects/56e7034bde0341e799d60bbf56ba03ce/users/fddfb4ff2afa4a56a4232d92d5a4e9fa/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:47.053194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab177106-ed2a-45e6-9995-6e4274728b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e7034bde0341e799d60bbf56ba03ce, user_id=fddfb4ff2afa4a56a4232d92d5a4e9fa, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:47.077333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 873/1739] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:46 2022] PUT /identity/v3/projects/c21abb4b62f548d7b98d65c4706fca5f/users/e227e16aaad54e12972e81cba41cf169/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:47.077705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab177106-ed2a-45e6-9995-6e4274728b1f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:47.093621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a938b4b-ba49-48f7-aee8-1927e45ee932 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:47.094171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a938b4b-ba49-48f7-aee8-1927e45ee932 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:47.097449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a938b4b-ba49-48f7-aee8-1927e45ee932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:47.170042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-2a938b4b-ba49-48f7-aee8-1927e45ee932 None None] MFA Rules not processed for user `e227e16aaad54e12972e81cba41cf169`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:47.174311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2a938b4b-ba49-48f7-aee8-1927e45ee932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:47.196778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 867/1740] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:46 2022] PUT /identity/v3/projects/56e7034bde0341e799d60bbf56ba03ce/users/fddfb4ff2afa4a56a4232d92d5a4e9fa/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:47.217213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb3fac-b138-4200-971e-dbf154e64438 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:47.217865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb3fac-b138-4200-971e-dbf154e64438 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:47.218366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb3fac-b138-4200-971e-dbf154e64438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:47.285151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-93eb3fac-b138-4200-971e-dbf154e64438 None None] MFA Rules not processed for user `fddfb4ff2afa4a56a4232d92d5a4e9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:47.287257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-93eb3fac-b138-4200-971e-dbf154e64438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:47.303152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 874/1741] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:47.303152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a938b4b-ba49-48f7-aee8-1927e45ee932 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:47.303152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2a938b4b-ba49-48f7-aee8-1927e45ee932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:47.400037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 868/1742] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:47.429632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a938b4b-ba49-48f7-aee8-1927e45ee932 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:47.444299 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb3fac-b138-4200-971e-dbf154e64438 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:47.446347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-93eb3fac-b138-4200-971e-dbf154e64438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:47.527174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550bcef-daeb-43b1-b31d-8a2b0299cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:47.528001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550bcef-daeb-43b1-b31d-8a2b0299cba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:47.528597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550bcef-daeb-43b1-b31d-8a2b0299cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:47.528706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550bcef-daeb-43b1-b31d-8a2b0299cba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:47.529390 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550bcef-daeb-43b1-b31d-8a2b0299cba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:47.531623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550bcef-daeb-43b1-b31d-8a2b0299cba2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:47.559448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb3fac-b138-4200-971e-dbf154e64438 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:47.563578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350820b-2235-429f-8142-75649f3ce7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:47.563578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350820b-2235-429f-8142-75649f3ce7e4 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:47.563939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350820b-2235-429f-8142-75649f3ce7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:47.564665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350820b-2235-429f-8142-75649f3ce7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:47.575720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350820b-2235-429f-8142-75649f3ce7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:47.577432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350820b-2235-429f-8142-75649f3ce7e4 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:47.588812 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 869/1743] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:47.730608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 875/1744] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:47 2022] POST /identity/v3/projects => generated 363 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:47.736300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350820b-2235-429f-8142-75649f3ce7e4 service nova] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:47.759046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350820b-2235-429f-8142-75649f3ce7e4 service nova] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:47.944238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550bcef-daeb-43b1-b31d-8a2b0299cba2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:47.962934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550bcef-daeb-43b1-b31d-8a2b0299cba2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:47.967125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170a91-f704-4ca5-9926-3c3c6172565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:47.969139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170a91-f704-4ca5-9926-3c3c6172565b admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:47.969603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170a91-f704-4ca5-9926-3c3c6172565b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:47.970068 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170a91-f704-4ca5-9926-3c3c6172565b admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:47.978640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10170a91-f704-4ca5-9926-3c3c6172565b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:47.982472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:47.983358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:47.983639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:47.983930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] PATH_INFO: `/v3/users/fddfb4ff2afa4a56a4232d92d5a4e9fa` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:47.985594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddfb4ff2afa4a56a4232d92d5a4e9fa)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:47.987529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:48.003333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10170a91-f704-4ca5-9926-3c3c6172565b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:48.156210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 870/1745] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:47 2022] POST /identity/v3/users => generated 288 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:48.161045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170a91-f704-4ca5-9926-3c3c6172565b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:48.174439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170a91-f704-4ca5-9926-3c3c6172565b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:48.180632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb1e24-cc53-4541-8bcf-d2cc6a2a4141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:48.181470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1e24-cc53-4541-8bcf-d2cc6a2a4141 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:48.181756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1e24-cc53-4541-8bcf-d2cc6a2a4141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:48.182031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1e24-cc53-4541-8bcf-d2cc6a2a4141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:48.182881 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb1e24-cc53-4541-8bcf-d2cc6a2a4141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:48.206705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb1e24-cc53-4541-8bcf-d2cc6a2a4141 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:48.236943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 871/1746] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:48.236943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb1e24-cc53-4541-8bcf-d2cc6a2a4141 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:48.236943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f1fb1e24-cc53-4541-8bcf-d2cc6a2a4141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:48.253840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb1e24-cc53-4541-8bcf-d2cc6a2a4141 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:48.259832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:48.261177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:48.261669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:48.262114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] PATH_INFO: `/v3/projects/7537e3ac2a344679a0b9e2774923f130` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:48.263768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7537e3ac2a344679a0b9e2774923f130)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:48.275780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:48.336992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddfb4ff2afa4a56a4232d92d5a4e9fa'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:48.474068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddfb4ff2afa4a56a4232d92d5a4e9fa'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:48.499791 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddfb4ff2afa4a56a4232d92d5a4e9fa'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:48.502584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddfb4ff2afa4a56a4232d92d5a4e9fa'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:48.503335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7537e3ac2a344679a0b9e2774923f130', 'request_id': 'req-86029694-2e4c-4a5a-89e3-c085dab4ab08'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:48.513488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7537e3ac2a344679a0b9e2774923f130', 'request_id': 'req-86029694-2e4c-4a5a-89e3-c085dab4ab08'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:48.520091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddfb4ff2afa4a56a4232d92d5a4e9fa'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:48.527402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 876/1747] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:47 2022] DELETE /identity/v3/users/fddfb4ff2afa4a56a4232d92d5a4e9fa => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:48.528246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:48.530493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:48.627076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74904746-fd90-4fbc-bacf-f7c8795e8d22 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:48.638546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396556fc-cb9e-47ec-aecd-3f0e06ec8b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:48.639507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396556fc-cb9e-47ec-aecd-3f0e06ec8b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:48.639840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396556fc-cb9e-47ec-aecd-3f0e06ec8b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:48.640144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396556fc-cb9e-47ec-aecd-3f0e06ec8b75 admin admin] PATH_INFO: `/v3/projects/e31103ac08904031872559e3f6ea4c8e/users/fdff9a3202c8423c9c0120ea71052150/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:48.645597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7537e3ac2a344679a0b9e2774923f130', 'request_id': 'req-86029694-2e4c-4a5a-89e3-c085dab4ab08'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:48.666901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] The token cache is being invalidate because project 7537e3ac2a344679a0b9e2774923f130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:48.667207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:48.671948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86029694-2e4c-4a5a-89e3-c085dab4ab08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:48.674211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 872/1748] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:48 2022] DELETE /identity/v3/projects/7537e3ac2a344679a0b9e2774923f130 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:48.676339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069431f-9620-4275-82e5-6837a5d314f4 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:48.676912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069431f-9620-4275-82e5-6837a5d314f4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:48.678038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069431f-9620-4275-82e5-6837a5d314f4 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:48.681398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 873/1749] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:20:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:48.683150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae451476-34cf-414d-84db-12ff4c55357b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:48.683603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae451476-34cf-414d-84db-12ff4c55357b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:48.684206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae451476-34cf-414d-84db-12ff4c55357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:48.687476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396556fc-cb9e-47ec-aecd-3f0e06ec8b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31103ac08904031872559e3f6ea4c8e, user_id=fdff9a3202c8423c9c0120ea71052150, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:48.691844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396556fc-cb9e-47ec-aecd-3f0e06ec8b75 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:48.709727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-ae451476-34cf-414d-84db-12ff4c55357b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:48.711386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ae451476-34cf-414d-84db-12ff4c55357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:48.729950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 874/1750] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:48.735890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2005ff-2089-427d-9734-3a3c2a8bd84e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:48.736413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2005ff-2089-427d-9734-3a3c2a8bd84e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:48.736775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2005ff-2089-427d-9734-3a3c2a8bd84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:48.772667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-bc2005ff-2089-427d-9734-3a3c2a8bd84e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:48.772667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bc2005ff-2089-427d-9734-3a3c2a8bd84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:48.775381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 875/1751] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:48.776960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22622563-0716-45d4-9754-c5b47ea6955d None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:48.777483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22622563-0716-45d4-9754-c5b47ea6955d None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:48.778148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22622563-0716-45d4-9754-c5b47ea6955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:48.816852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 877/1752] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:48 2022] PUT /identity/v3/projects/e31103ac08904031872559e3f6ea4c8e/users/fdff9a3202c8423c9c0120ea71052150/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:48.816852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396556fc-cb9e-47ec-aecd-3f0e06ec8b75 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:48.817053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-22622563-0716-45d4-9754-c5b47ea6955d None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:48.817053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-22622563-0716-45d4-9754-c5b47ea6955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:48.821600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-396556fc-cb9e-47ec-aecd-3f0e06ec8b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:48.907978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396556fc-cb9e-47ec-aecd-3f0e06ec8b75 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:48.913378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b98754-7644-4499-88bd-9c877ef57c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:48.914004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 876/1753] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:48.915619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288a151-76bd-40b3-9b7d-bdfb244d7547 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:48.915619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288a151-76bd-40b3-9b7d-bdfb244d7547 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:48.915801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288a151-76bd-40b3-9b7d-bdfb244d7547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:48.919786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b98754-7644-4499-88bd-9c877ef57c2a service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:48.920482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b98754-7644-4499-88bd-9c877ef57c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:48.920763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b98754-7644-4499-88bd-9c877ef57c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:48.937564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9288a151-76bd-40b3-9b7d-bdfb244d7547 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:48.938958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9288a151-76bd-40b3-9b7d-bdfb244d7547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:48.992311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b98754-7644-4499-88bd-9c877ef57c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:48.994201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b98754-7644-4499-88bd-9c877ef57c2a service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.002669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 877/1754] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:49.003840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288a151-76bd-40b3-9b7d-bdfb244d7547 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.006249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 878/1755] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:49.007425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b98754-7644-4499-88bd-9c877ef57c2a service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.008358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9288a151-76bd-40b3-9b7d-bdfb244d7547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:49.008759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-80b98754-7644-4499-88bd-9c877ef57c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:49.023073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288a151-76bd-40b3-9b7d-bdfb244d7547 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.030796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b8bfc-0bcc-4e57-89da-5cc5ee4cd65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.031564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b8bfc-0bcc-4e57-89da-5cc5ee4cd65a admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.031942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b8bfc-0bcc-4e57-89da-5cc5ee4cd65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.032291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b8bfc-0bcc-4e57-89da-5cc5ee4cd65a admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.033168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b8bfc-0bcc-4e57-89da-5cc5ee4cd65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.035224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b8bfc-0bcc-4e57-89da-5cc5ee4cd65a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.045125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b98754-7644-4499-88bd-9c877ef57c2a service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.048152 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 878/1756] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:49.048920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b8bfc-0bcc-4e57-89da-5cc5ee4cd65a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.057811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f0624-ed9b-4e53-baae-9de6663a9856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.058579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f0624-ed9b-4e53-baae-9de6663a9856 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.058929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f0624-ed9b-4e53-baae-9de6663a9856 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.059204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f0624-ed9b-4e53-baae-9de6663a9856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.059898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b8bfc-0bcc-4e57-89da-5cc5ee4cd65a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.065742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c810-4005-4cf1-a7d8-a3d83ebcb8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.066489 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c810-4005-4cf1-a7d8-a3d83ebcb8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.066779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c810-4005-4cf1-a7d8-a3d83ebcb8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.067131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c810-4005-4cf1-a7d8-a3d83ebcb8e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.068428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c810-4005-4cf1-a7d8-a3d83ebcb8e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:49.068749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c810-4005-4cf1-a7d8-a3d83ebcb8e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.069911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f0624-ed9b-4e53-baae-9de6663a9856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.070339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c810-4005-4cf1-a7d8-a3d83ebcb8e7 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.071569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f0624-ed9b-4e53-baae-9de6663a9856 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.079915 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:49.083262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 879/1757] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:49.085835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f0624-ed9b-4e53-baae-9de6663a9856 service nova] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.091917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 879/1758] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:49.099452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f0624-ed9b-4e53-baae-9de6663a9856 service nova] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.100172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c810-4005-4cf1-a7d8-a3d83ebcb8e7 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.106058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e60f85-2f5c-41f0-9710-cbb2062cc4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.107195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e60f85-2f5c-41f0-9710-cbb2062cc4be admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.107905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e60f85-2f5c-41f0-9710-cbb2062cc4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.107905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e60f85-2f5c-41f0-9710-cbb2062cc4be admin admin] PATH_INFO: `/v3/projects/e31103ac08904031872559e3f6ea4c8e/users/fdff9a3202c8423c9c0120ea71052150/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.110669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e60f85-2f5c-41f0-9710-cbb2062cc4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31103ac08904031872559e3f6ea4c8e, user_id=fdff9a3202c8423c9c0120ea71052150, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.113019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c810-4005-4cf1-a7d8-a3d83ebcb8e7 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.113866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e60f85-2f5c-41f0-9710-cbb2062cc4be admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.118884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8c322-d587-4285-8de0-b86d33d1cba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.119558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8c322-d587-4285-8de0-b86d33d1cba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.119842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8c322-d587-4285-8de0-b86d33d1cba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.120155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8c322-d587-4285-8de0-b86d33d1cba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.120948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8c322-d587-4285-8de0-b86d33d1cba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.123246 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8c322-d587-4285-8de0-b86d33d1cba1 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.126159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 880/1759] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:49 2022] PUT /identity/v3/projects/e31103ac08904031872559e3f6ea4c8e/users/fdff9a3202c8423c9c0120ea71052150/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:49.140773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16580c3-3959-4526-9c0e-c76589f97df0 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.141066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16580c3-3959-4526-9c0e-c76589f97df0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.141393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16580c3-3959-4526-9c0e-c76589f97df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.167406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a16580c3-3959-4526-9c0e-c76589f97df0 None None] MFA Rules not processed for user `fdff9a3202c8423c9c0120ea71052150`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:49.168649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a16580c3-3959-4526-9c0e-c76589f97df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:49.188394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:DELETE=6,keystone:SELECT=85,keystone:INSERT=9 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:49.236241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 880/1760] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:49 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:49.242155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8c322-d587-4285-8de0-b86d33d1cba1 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.247398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 881/1761] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:49 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:49.257718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16580c3-3959-4526-9c0e-c76589f97df0 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.259483 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a16580c3-3959-4526-9c0e-c76589f97df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:49.331131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16580c3-3959-4526-9c0e-c76589f97df0 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.332600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8c322-d587-4285-8de0-b86d33d1cba1 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.337494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485369c-301d-40b8-8a4f-229e36b43ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.337690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485369c-301d-40b8-8a4f-229e36b43ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.338005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485369c-301d-40b8-8a4f-229e36b43ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.338262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485369c-301d-40b8-8a4f-229e36b43ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.339226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485369c-301d-40b8-8a4f-229e36b43ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.341323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485369c-301d-40b8-8a4f-229e36b43ee3 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.402183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd326de1-ab31-479f-895e-09550c40387f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.403008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326de1-ab31-479f-895e-09550c40387f service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.403437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326de1-ab31-479f-895e-09550c40387f service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.403789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326de1-ab31-479f-895e-09550c40387f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.485108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd326de1-ab31-479f-895e-09550c40387f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.486562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd326de1-ab31-479f-895e-09550c40387f service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.496643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 882/1762] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:49 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:20:49.520990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 881/1763] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:49 2022] POST /identity/v3/users => generated 285 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:49.524889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd326de1-ab31-479f-895e-09550c40387f service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.537527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd326de1-ab31-479f-895e-09550c40387f service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.542842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3be44a-9ef9-4ddf-bb5c-edeb211950a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.543345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3be44a-9ef9-4ddf-bb5c-edeb211950a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.543732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3be44a-9ef9-4ddf-bb5c-edeb211950a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.544021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3be44a-9ef9-4ddf-bb5c-edeb211950a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.544758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3be44a-9ef9-4ddf-bb5c-edeb211950a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.546385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3be44a-9ef9-4ddf-bb5c-edeb211950a7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.558165 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 883/1764] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:49.562045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485369c-301d-40b8-8a4f-229e36b43ee3 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.575124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485369c-301d-40b8-8a4f-229e36b43ee3 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.580046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409e503-896c-4cf9-a449-167697b6ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.580745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e503-896c-4cf9-a449-167697b6ee0f admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.581032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e503-896c-4cf9-a449-167697b6ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.581352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e503-896c-4cf9-a449-167697b6ee0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.582049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409e503-896c-4cf9-a449-167697b6ee0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.583698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409e503-896c-4cf9-a449-167697b6ee0f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.595119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 882/1765] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:49.599767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3be44a-9ef9-4ddf-bb5c-edeb211950a7 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.619401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3be44a-9ef9-4ddf-bb5c-edeb211950a7 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.619401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f712d-8bdd-4970-96be-1c2ffe087bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.619401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f712d-8bdd-4970-96be-1c2ffe087bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.619401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f712d-8bdd-4970-96be-1c2ffe087bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.619693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f712d-8bdd-4970-96be-1c2ffe087bd9 admin admin] PATH_INFO: `/v3/projects/6c4f69786a2542088b0613d7af475d75/users/4cd0252c99c749a0b433525d69de24ec/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.622524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409e503-896c-4cf9-a449-167697b6ee0f admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:49.625481 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a409e503-896c-4cf9-a449-167697b6ee0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:49.656004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f712d-8bdd-4970-96be-1c2ffe087bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4f69786a2542088b0613d7af475d75, user_id=4cd0252c99c749a0b433525d69de24ec, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.660491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f712d-8bdd-4970-96be-1c2ffe087bd9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.677053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409e503-896c-4cf9-a449-167697b6ee0f admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:49.683756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:49.685173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.685626 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.686063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] PATH_INFO: `/v3/projects/56e7034bde0341e799d60bbf56ba03ce` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.687641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e7034bde0341e799d60bbf56ba03ce)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:49.691500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:49.867563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 884/1766] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:49 2022] PUT /identity/v3/projects/6c4f69786a2542088b0613d7af475d75/users/4cd0252c99c749a0b433525d69de24ec/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:49.885704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f454ef8-97ac-4efe-82e8-2eec2477a4fc None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:49.886095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f454ef8-97ac-4efe-82e8-2eec2477a4fc None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:49.888270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f454ef8-97ac-4efe-82e8-2eec2477a4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:49.951833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e7034bde0341e799d60bbf56ba03ce', 'request_id': 'req-a1d46cd3-3a11-4e2d-9f71-d69865730416'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:49.955241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8f454ef8-97ac-4efe-82e8-2eec2477a4fc None None] MFA Rules not processed for user `4cd0252c99c749a0b433525d69de24ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:49.956578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8f454ef8-97ac-4efe-82e8-2eec2477a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:49.975956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e7034bde0341e799d60bbf56ba03ce', 'request_id': 'req-a1d46cd3-3a11-4e2d-9f71-d69865730416'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:50.072364 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 885/1767] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:50.076786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f454ef8-97ac-4efe-82e8-2eec2477a4fc None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.148243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e7034bde0341e799d60bbf56ba03ce', 'request_id': 'req-a1d46cd3-3a11-4e2d-9f71-d69865730416'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:50.153934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f454ef8-97ac-4efe-82e8-2eec2477a4fc None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.159510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d61070-4f0e-4017-b6ab-50f629f747a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.160241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d61070-4f0e-4017-b6ab-50f629f747a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.160530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d61070-4f0e-4017-b6ab-50f629f747a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.160815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d61070-4f0e-4017-b6ab-50f629f747a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.163297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-24d61070-4f0e-4017-b6ab-50f629f747a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:50.163744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] The token cache is being invalidate because project 56e7034bde0341e799d60bbf56ba03ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:50.164192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:50.166274 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:50.171708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 883/1768] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:49 2022] DELETE /identity/v3/projects/56e7034bde0341e799d60bbf56ba03ce => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:20:50.171708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.171708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:50.232995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d61070-4f0e-4017-b6ab-50f629f747a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.234632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d61070-4f0e-4017-b6ab-50f629f747a4 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.244711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 886/1769] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:50.246242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480fe9-b495-4c6b-bbd0-7fabb7757bc6 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.246633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480fe9-b495-4c6b-bbd0-7fabb7757bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.247012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480fe9-b495-4c6b-bbd0-7fabb7757bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.252736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46cd3-3a11-4e2d-9f71-d69865730416 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.259085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7f69b-964c-486d-ad77-2beabcf150c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.260182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7f69b-964c-486d-ad77-2beabcf150c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.260749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7f69b-964c-486d-ad77-2beabcf150c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.264973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7f69b-964c-486d-ad77-2beabcf150c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.264973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7f69b-964c-486d-ad77-2beabcf150c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.264973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7f69b-964c-486d-ad77-2beabcf150c7 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.268491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-59480fe9-b495-4c6b-bbd0-7fabb7757bc6 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:50.269841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-59480fe9-b495-4c6b-bbd0-7fabb7757bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:50.279106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 887/1770] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:50.289008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d878e2e-f01a-4248-9882-13281215d43d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.289392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d878e2e-f01a-4248-9882-13281215d43d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.289768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d878e2e-f01a-4248-9882-13281215d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.309839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3d878e2e-f01a-4248-9882-13281215d43d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:50.311142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3d878e2e-f01a-4248-9882-13281215d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:50.320206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 888/1771] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:50.323974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d878e2e-f01a-4248-9882-13281215d43d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.333131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d878e2e-f01a-4248-9882-13281215d43d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.339712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b476-1c04-4fa4-8012-8c6ea590cac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.340417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b476-1c04-4fa4-8012-8c6ea590cac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.340709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b476-1c04-4fa4-8012-8c6ea590cac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.341188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b476-1c04-4fa4-8012-8c6ea590cac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.341966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b476-1c04-4fa4-8012-8c6ea590cac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:50.342639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b476-1c04-4fa4-8012-8c6ea590cac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.344384 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b476-1c04-4fa4-8012-8c6ea590cac4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.357838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 889/1772] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:20:50.362657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b476-1c04-4fa4-8012-8c6ea590cac4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.373587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b476-1c04-4fa4-8012-8c6ea590cac4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.388891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2cc9-c765-420b-8529-d35f62de4070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.389689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2cc9-c765-420b-8529-d35f62de4070 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.390042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2cc9-c765-420b-8529-d35f62de4070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.390386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e2cc9-c765-420b-8529-d35f62de4070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.391180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2cc9-c765-420b-8529-d35f62de4070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.393961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e2cc9-c765-420b-8529-d35f62de4070 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.430117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 884/1773] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:50 2022] POST /identity/v3/projects => generated 367 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:50.434088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7f69b-964c-486d-ad77-2beabcf150c7 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.500634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7f69b-964c-486d-ad77-2beabcf150c7 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.505964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e028756-9ef3-46b7-9e45-606e980a1778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.506904 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e028756-9ef3-46b7-9e45-606e980a1778 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.507192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e028756-9ef3-46b7-9e45-606e980a1778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.507467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e028756-9ef3-46b7-9e45-606e980a1778 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.508196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e028756-9ef3-46b7-9e45-606e980a1778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.510207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e028756-9ef3-46b7-9e45-606e980a1778 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.561182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 890/1774] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:50 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:20:50.565305 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2cc9-c765-420b-8529-d35f62de4070 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.627443 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e2cc9-c765-420b-8529-d35f62de4070 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.632228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04698b5-7791-44be-b763-5f51c28b164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.632910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04698b5-7791-44be-b763-5f51c28b164f admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.633190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04698b5-7791-44be-b763-5f51c28b164f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.633464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04698b5-7791-44be-b763-5f51c28b164f admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.634147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04698b5-7791-44be-b763-5f51c28b164f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.636160 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04698b5-7791-44be-b763-5f51c28b164f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.673810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 885/1775] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:50 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:20:50.677499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e028756-9ef3-46b7-9e45-606e980a1778 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.687002 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e028756-9ef3-46b7-9e45-606e980a1778 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.691806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a0125-9840-4b39-82b0-1ffc3355c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.692506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0125-9840-4b39-82b0-1ffc3355c12f admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.692790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0125-9840-4b39-82b0-1ffc3355c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.693066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0125-9840-4b39-82b0-1ffc3355c12f admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.693774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a0125-9840-4b39-82b0-1ffc3355c12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.695396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a0125-9840-4b39-82b0-1ffc3355c12f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.708882 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 886/1776] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:20:50.709848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a0125-9840-4b39-82b0-1ffc3355c12f admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.719570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a0125-9840-4b39-82b0-1ffc3355c12f admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.724705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fc0b0-7fff-4e1d-9844-44ff512b5d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.725560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fc0b0-7fff-4e1d-9844-44ff512b5d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.725844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fc0b0-7fff-4e1d-9844-44ff512b5d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.726120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fc0b0-7fff-4e1d-9844-44ff512b5d7c admin admin] PATH_INFO: `/v3/projects/052a2bc79665434ca8448f5384d1f530/users/a420fab5425e4d50bb72cbe2f5000672/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.741228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fc0b0-7fff-4e1d-9844-44ff512b5d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=052a2bc79665434ca8448f5384d1f530, user_id=a420fab5425e4d50bb72cbe2f5000672, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.743863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fc0b0-7fff-4e1d-9844-44ff512b5d7c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.776027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 891/1777] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:50 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:50.782336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04698b5-7791-44be-b763-5f51c28b164f admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.789829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04698b5-7791-44be-b763-5f51c28b164f admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.794418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084962-175b-4950-8d5e-c1e5d813d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.795053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084962-175b-4950-8d5e-c1e5d813d8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.795338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084962-175b-4950-8d5e-c1e5d813d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.795617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084962-175b-4950-8d5e-c1e5d813d8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.796368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1084962-175b-4950-8d5e-c1e5d813d8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.797951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1084962-175b-4950-8d5e-c1e5d813d8d1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.808065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 892/1778] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:20:50.818954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084962-175b-4950-8d5e-c1e5d813d8d1 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.829096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084962-175b-4950-8d5e-c1e5d813d8d1 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.835564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955e046-6e3d-4cb3-9b81-10079755f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.836429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955e046-6e3d-4cb3-9b81-10079755f08c admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.836723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955e046-6e3d-4cb3-9b81-10079755f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.837004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955e046-6e3d-4cb3-9b81-10079755f08c admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.837779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955e046-6e3d-4cb3-9b81-10079755f08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.839629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955e046-6e3d-4cb3-9b81-10079755f08c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.852365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 893/1779] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:50.855565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955e046-6e3d-4cb3-9b81-10079755f08c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.865302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955e046-6e3d-4cb3-9b81-10079755f08c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.870063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ef37e-9819-4afc-9d80-34207f151302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.870943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef37e-9819-4afc-9d80-34207f151302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.871127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef37e-9819-4afc-9d80-34207f151302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.871403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef37e-9819-4afc-9d80-34207f151302 admin admin] PATH_INFO: `/v3/projects/8058b82c67604a53bb2fa62eda08f59a/users/f9f8d1a5624d480d9e2c9bd7d40ce0f6/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.885606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 887/1780] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:50 2022] PUT /identity/v3/projects/052a2bc79665434ca8448f5384d1f530/users/a420fab5425e4d50bb72cbe2f5000672/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:20:50.886541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ef37e-9819-4afc-9d80-34207f151302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8058b82c67604a53bb2fa62eda08f59a, user_id=f9f8d1a5624d480d9e2c9bd7d40ce0f6, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.889242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ef37e-9819-4afc-9d80-34207f151302 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.890257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fc0b0-7fff-4e1d-9844-44ff512b5d7c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.951367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fc0b0-7fff-4e1d-9844-44ff512b5d7c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.956016 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d25a12-c512-406f-a934-85114e853738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.956680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d25a12-c512-406f-a934-85114e853738 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.956965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d25a12-c512-406f-a934-85114e853738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.957240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d25a12-c512-406f-a934-85114e853738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.958060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d25a12-c512-406f-a934-85114e853738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.960261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d25a12-c512-406f-a934-85114e853738 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:50.970328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 888/1781] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:20:50.974537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d25a12-c512-406f-a934-85114e853738 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:50.984782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d25a12-c512-406f-a934-85114e853738 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:50.990298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2f2ab-043d-4c75-adeb-43598ddb6e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:50.991194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2f2ab-043d-4c75-adeb-43598ddb6e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:50.991749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2f2ab-043d-4c75-adeb-43598ddb6e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:50.992302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2f2ab-043d-4c75-adeb-43598ddb6e95 admin admin] PATH_INFO: `/v3/projects/052a2bc79665434ca8448f5384d1f530/users/a420fab5425e4d50bb72cbe2f5000672/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:50.994807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2f2ab-043d-4c75-adeb-43598ddb6e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=052a2bc79665434ca8448f5384d1f530, user_id=a420fab5425e4d50bb72cbe2f5000672, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:50.999548 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2f2ab-043d-4c75-adeb-43598ddb6e95 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:51.009399 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 894/1782] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:50 2022] PUT /identity/v3/projects/8058b82c67604a53bb2fa62eda08f59a/users/f9f8d1a5624d480d9e2c9bd7d40ce0f6/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:20:51.019240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 889/1783] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:50 2022] PUT /identity/v3/projects/052a2bc79665434ca8448f5384d1f530/users/a420fab5425e4d50bb72cbe2f5000672/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:20:51.020295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5afc7-08a7-44eb-82ee-d6fedbbff6cf None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:51.020597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5afc7-08a7-44eb-82ee-d6fedbbff6cf None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:51.021614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5afc7-08a7-44eb-82ee-d6fedbbff6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:51.030052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857a2a-7ec3-4861-a9c4-d9c719dda029 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:51.030353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857a2a-7ec3-4861-a9c4-d9c719dda029 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:51.030658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857a2a-7ec3-4861-a9c4-d9c719dda029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:51.056643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-48f5afc7-08a7-44eb-82ee-d6fedbbff6cf None None] MFA Rules not processed for user `f9f8d1a5624d480d9e2c9bd7d40ce0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:51.057888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-48f5afc7-08a7-44eb-82ee-d6fedbbff6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:51.066562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-bc857a2a-7ec3-4861-a9c4-d9c719dda029 None None] MFA Rules not processed for user `a420fab5425e4d50bb72cbe2f5000672`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:51.068444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bc857a2a-7ec3-4861-a9c4-d9c719dda029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:51.137445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 895/1784] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:51.141901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5afc7-08a7-44eb-82ee-d6fedbbff6cf None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:51.162537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 890/1785] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:51.186694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc857a2a-7ec3-4861-a9c4-d9c719dda029 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:51.188285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bc857a2a-7ec3-4861-a9c4-d9c719dda029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:51.222846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5afc7-08a7-44eb-82ee-d6fedbbff6cf None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:51.227493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9a8de-49ac-4f4f-b712-8a9c01d7bbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:51.228189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9a8de-49ac-4f4f-b712-8a9c01d7bbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:51.228551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9a8de-49ac-4f4f-b712-8a9c01d7bbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:51.228740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9a8de-49ac-4f4f-b712-8a9c01d7bbe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:51.229418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9a8de-49ac-4f4f-b712-8a9c01d7bbe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:51.231366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9a8de-49ac-4f4f-b712-8a9c01d7bbe0 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:51.250939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc857a2a-7ec3-4861-a9c4-d9c719dda029 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:51.257346 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfee914-762e-455e-b068-534543d4fa94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:51.258120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee914-762e-455e-b068-534543d4fa94 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:51.258506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee914-762e-455e-b068-534543d4fa94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:51.258794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee914-762e-455e-b068-534543d4fa94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:51.275113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfee914-762e-455e-b068-534543d4fa94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:51.276583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfee914-762e-455e-b068-534543d4fa94 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:51.286657 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 891/1786] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:51.407021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 896/1787] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:51 2022] POST /identity/v3/projects => generated 381 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:20:51.411327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfee914-762e-455e-b068-534543d4fa94 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:51.423305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfee914-762e-455e-b068-534543d4fa94 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:51.496065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aa059-ba7a-4d1c-b6c3-b9dc323ba12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:51.496750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aa059-ba7a-4d1c-b6c3-b9dc323ba12a admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:51.497040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aa059-ba7a-4d1c-b6c3-b9dc323ba12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:51.497320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aa059-ba7a-4d1c-b6c3-b9dc323ba12a admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:51.498022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4aa059-ba7a-4d1c-b6c3-b9dc323ba12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:51.499987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4aa059-ba7a-4d1c-b6c3-b9dc323ba12a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:51.662762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 892/1788] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:51 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:20:51.667112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9a8de-49ac-4f4f-b712-8a9c01d7bbe0 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:51.682892 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9a8de-49ac-4f4f-b712-8a9c01d7bbe0 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:51.687363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a2902-a517-42bc-811c-d00999f052e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:51.688060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a2902-a517-42bc-811c-d00999f052e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:51.688343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a2902-a517-42bc-811c-d00999f052e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:51.688615 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a2902-a517-42bc-811c-d00999f052e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:51.689335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a2902-a517-42bc-811c-d00999f052e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:51.690915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a2902-a517-42bc-811c-d00999f052e4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:51.701607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 897/1789] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:51.705727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aa059-ba7a-4d1c-b6c3-b9dc323ba12a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:51.715974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aa059-ba7a-4d1c-b6c3-b9dc323ba12a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:51.720639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c49d2-36f2-413c-8ae0-849de9e8bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:51.721518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c49d2-36f2-413c-8ae0-849de9e8bf46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:51.721799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c49d2-36f2-413c-8ae0-849de9e8bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:51.722076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c49d2-36f2-413c-8ae0-849de9e8bf46 admin admin] PATH_INFO: `/v3/projects/7a1d5bb8656c4d9b84000573aff422e0/users/4acc792578d348d8ba13987007935b67/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:51.738749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c49d2-36f2-413c-8ae0-849de9e8bf46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1d5bb8656c4d9b84000573aff422e0, user_id=4acc792578d348d8ba13987007935b67, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:51.742792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c49d2-36f2-413c-8ae0-849de9e8bf46 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:51.891084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 893/1790] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:51 2022] PUT /identity/v3/projects/7a1d5bb8656c4d9b84000573aff422e0/users/4acc792578d348d8ba13987007935b67/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:51.899048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a2902-a517-42bc-811c-d00999f052e4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:51.912216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a2902-a517-42bc-811c-d00999f052e4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:51.987297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc4c95-f755-4861-b10f-99937be6e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:51.988022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc4c95-f755-4861-b10f-99937be6e128 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:51.988308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc4c95-f755-4861-b10f-99937be6e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:51.988586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc4c95-f755-4861-b10f-99937be6e128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:51.989352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc4c95-f755-4861-b10f-99937be6e128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:51.991496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc4c95-f755-4861-b10f-99937be6e128 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:52.004543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 898/1791] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:52.005811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c49d2-36f2-413c-8ae0-849de9e8bf46 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:52.016405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c49d2-36f2-413c-8ae0-849de9e8bf46 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:52.021015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bec88-cee8-461a-aebe-b99ef4d1fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:52.021932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bec88-cee8-461a-aebe-b99ef4d1fb96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:52.022208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bec88-cee8-461a-aebe-b99ef4d1fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:52.022485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bec88-cee8-461a-aebe-b99ef4d1fb96 admin admin] PATH_INFO: `/v3/projects/7a1d5bb8656c4d9b84000573aff422e0/users/4acc792578d348d8ba13987007935b67/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:52.024478 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bec88-cee8-461a-aebe-b99ef4d1fb96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1d5bb8656c4d9b84000573aff422e0, user_id=4acc792578d348d8ba13987007935b67, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:52.027383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bec88-cee8-461a-aebe-b99ef4d1fb96 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:52.038368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 894/1792] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:52 2022] PUT /identity/v3/projects/7a1d5bb8656c4d9b84000573aff422e0/users/4acc792578d348d8ba13987007935b67/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:52.051274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb3be-95e3-4bb3-aee2-005dcc8c81b6 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:52.051565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb3be-95e3-4bb3-aee2-005dcc8c81b6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:52.051844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb3be-95e3-4bb3-aee2-005dcc8c81b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:52.079732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-756bb3be-95e3-4bb3-aee2-005dcc8c81b6 None None] MFA Rules not processed for user `4acc792578d348d8ba13987007935b67`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:52.081046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-756bb3be-95e3-4bb3-aee2-005dcc8c81b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:52.156787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 899/1793] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:52.232631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bec88-cee8-461a-aebe-b99ef4d1fb96 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:52.234294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-617bec88-cee8-461a-aebe-b99ef4d1fb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:52.303719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bec88-cee8-461a-aebe-b99ef4d1fb96 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:52.312191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23bdb5-7b06-4880-879f-702555ce46b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:52.313220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23bdb5-7b06-4880-879f-702555ce46b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:52.313552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23bdb5-7b06-4880-879f-702555ce46b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:52.313882 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23bdb5-7b06-4880-879f-702555ce46b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:52.328752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23bdb5-7b06-4880-879f-702555ce46b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:52.330714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23bdb5-7b06-4880-879f-702555ce46b5 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:52.343219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 895/1794] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:52.519457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:52.799777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:53.864475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9083-20dc-4749-9267-c574d5a70867 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:53.865571 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9083-20dc-4749-9267-c574d5a70867 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:53.866086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b9083-20dc-4749-9267-c574d5a70867 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:53.867703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 900/1795] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:20:53.882717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ab6c-babe-4a0a-b292-feab07d6728a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:53.884195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ab6c-babe-4a0a-b292-feab07d6728a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:53.884527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ab6c-babe-4a0a-b292-feab07d6728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:53.903828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9138ab6c-babe-4a0a-b292-feab07d6728a None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:53.905167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9138ab6c-babe-4a0a-b292-feab07d6728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:54.000841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 896/1796] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:20:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:54.182932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b9083-20dc-4749-9267-c574d5a70867 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:54.187627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-134b9083-20dc-4749-9267-c574d5a70867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:54.215420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b9083-20dc-4749-9267-c574d5a70867 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:54.242382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755a8d8-2c83-4647-b4a0-5dbde1df5ea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:54.243597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755a8d8-2c83-4647-b4a0-5dbde1df5ea1 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:54.245082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755a8d8-2c83-4647-b4a0-5dbde1df5ea1 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:54.245082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755a8d8-2c83-4647-b4a0-5dbde1df5ea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:54.293774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755a8d8-2c83-4647-b4a0-5dbde1df5ea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:54.293774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755a8d8-2c83-4647-b4a0-5dbde1df5ea1 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:54.296149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138ab6c-babe-4a0a-b292-feab07d6728a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:54.317191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138ab6c-babe-4a0a-b292-feab07d6728a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:54.338604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd83590-8b70-4f60-9cd8-911bd982fac0 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc792578d348d8ba13987007935b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a1d5bb8656c4d9b84000573aff422e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:54.339664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd83590-8b70-4f60-9cd8-911bd982fac0 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:54.340151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd83590-8b70-4f60-9cd8-911bd982fac0 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:54.340588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 901/1797] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:54.340952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd83590-8b70-4f60-9cd8-911bd982fac0 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:54.342005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd83590-8b70-4f60-9cd8-911bd982fac0 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:54.342713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd83590-8b70-4f60-9cd8-911bd982fac0 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:54.344783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd83590-8b70-4f60-9cd8-911bd982fac0 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:54.375707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 897/1798] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:54.388467 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755a8d8-2c83-4647-b4a0-5dbde1df5ea1 service nova] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:54.408005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755a8d8-2c83-4647-b4a0-5dbde1df5ea1 service nova] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:54.421441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b94da-11cb-4a8f-8375-1c880e97e4ed tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc792578d348d8ba13987007935b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a1d5bb8656c4d9b84000573aff422e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:54.422113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b94da-11cb-4a8f-8375-1c880e97e4ed tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:54.422401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b94da-11cb-4a8f-8375-1c880e97e4ed tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:54.422679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b94da-11cb-4a8f-8375-1c880e97e4ed tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:54.423381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b94da-11cb-4a8f-8375-1c880e97e4ed tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:54.425365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b94da-11cb-4a8f-8375-1c880e97e4ed tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:54.603492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 902/1799] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:54 2022] POST /identity/v3/projects => generated 354 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:54.609196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd83590-8b70-4f60-9cd8-911bd982fac0 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:54.619206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd83590-8b70-4f60-9cd8-911bd982fac0 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:54.698681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e138b-6ecd-4e8d-907c-93d4530fae22 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc792578d348d8ba13987007935b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a1d5bb8656c4d9b84000573aff422e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:54.699580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e138b-6ecd-4e8d-907c-93d4530fae22 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:54.699941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e138b-6ecd-4e8d-907c-93d4530fae22 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:54.700192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e138b-6ecd-4e8d-907c-93d4530fae22 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:54.701289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e138b-6ecd-4e8d-907c-93d4530fae22 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:54.701289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e138b-6ecd-4e8d-907c-93d4530fae22 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:54.702975 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e138b-6ecd-4e8d-907c-93d4530fae22 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:54.718902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 898/1800] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:20:54.768772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b94da-11cb-4a8f-8375-1c880e97e4ed tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:54.782834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b94da-11cb-4a8f-8375-1c880e97e4ed tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:54.787549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc792578d348d8ba13987007935b67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a1d5bb8656c4d9b84000573aff422e0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:54.788459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:54.788752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:54.789027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] PATH_INFO: `/v3/projects/a55f5646ee014f83b7fb17b0d0493f67` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:54.790246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a55f5646ee014f83b7fb17b0d0493f67)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:54.792191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:54.933137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55f5646ee014f83b7fb17b0d0493f67', 'request_id': 'req-b8ff483e-8a87-401e-a87a-d48a9ee496f7'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:54.936743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55f5646ee014f83b7fb17b0d0493f67', 'request_id': 'req-b8ff483e-8a87-401e-a87a-d48a9ee496f7'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:55.039045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55f5646ee014f83b7fb17b0d0493f67', 'request_id': 'req-b8ff483e-8a87-401e-a87a-d48a9ee496f7'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:55.051052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] The token cache is being invalidate because project a55f5646ee014f83b7fb17b0d0493f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:55.051347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:55.052785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b8ff483e-8a87-401e-a87a-d48a9ee496f7 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:55.058109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 903/1801] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:54 2022] DELETE /identity/v3/projects/a55f5646ee014f83b7fb17b0d0493f67 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:55.697334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:56.050564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:56.205839 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e138b-6ecd-4e8d-907c-93d4530fae22 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:56.207641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cf8e138b-6ecd-4e8d-907c-93d4530fae22 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:56.276244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e138b-6ecd-4e8d-907c-93d4530fae22 tempest-VolumeQuotaClassesTest-1546508561 tempest-VolumeQuotaClassesTest-1546508561-project-admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:56.330363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:56.331239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:56.331525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:56.331804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] PATH_INFO: `/v3/users/f9f8d1a5624d480d9e2c9bd7d40ce0f6` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:56.333053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f8d1a5624d480d9e2c9bd7d40ce0f6)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:56.335581 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:56.551378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f8d1a5624d480d9e2c9bd7d40ce0f6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:56.634908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f8d1a5624d480d9e2c9bd7d40ce0f6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:56.649169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f8d1a5624d480d9e2c9bd7d40ce0f6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:56.650226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f8d1a5624d480d9e2c9bd7d40ce0f6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:56.658088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f8d1a5624d480d9e2c9bd7d40ce0f6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:56.664543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 899/1802] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:56 2022] DELETE /identity/v3/users/f9f8d1a5624d480d9e2c9bd7d40ce0f6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:56.669142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed19b-f5cd-4482-9ab7-d36cbdca1caa None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:56.669429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed19b-f5cd-4482-9ab7-d36cbdca1caa None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:56.669707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed19b-f5cd-4482-9ab7-d36cbdca1caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:56.690540 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4d1ed19b-f5cd-4482-9ab7-d36cbdca1caa None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:56.691753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4d1ed19b-f5cd-4482-9ab7-d36cbdca1caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:56.759943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 904/1803] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:56.769724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:56.771367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:56.832796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f0da-f4c1-4102-b87f-201f3bbb490d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:56.836546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a17be-d70d-491e-90b6-bc3f136de46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:56.837232 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a17be-d70d-491e-90b6-bc3f136de46f service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:56.837515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a17be-d70d-491e-90b6-bc3f136de46f service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:56.837791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a17be-d70d-491e-90b6-bc3f136de46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:56.848119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a17be-d70d-491e-90b6-bc3f136de46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:56.849838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a17be-d70d-491e-90b6-bc3f136de46f service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:56.860891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 900/1804] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:20:57.362139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ed19b-f5cd-4482-9ab7-d36cbdca1caa None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:57.363564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4d1ed19b-f5cd-4482-9ab7-d36cbdca1caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:57.377133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ed19b-f5cd-4482-9ab7-d36cbdca1caa None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:57.382681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:57.383503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:57.383795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:57.384241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] PATH_INFO: `/v3/projects/8058b82c67604a53bb2fa62eda08f59a` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:57.385484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8058b82c67604a53bb2fa62eda08f59a)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:57.387420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:57.443617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a17be-d70d-491e-90b6-bc3f136de46f service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:57.445081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-774a17be-d70d-491e-90b6-bc3f136de46f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:57.457530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a17be-d70d-491e-90b6-bc3f136de46f service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:57.462775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:57.464021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:57.465043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:57.465043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] PATH_INFO: `/v3/users/4cd0252c99c749a0b433525d69de24ec` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:57.465772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd0252c99c749a0b433525d69de24ec)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:57.467738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:57.541224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8058b82c67604a53bb2fa62eda08f59a', 'request_id': 'req-8a528584-65b1-4371-bdad-55d9b7da7ec9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.548320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8058b82c67604a53bb2fa62eda08f59a', 'request_id': 'req-8a528584-65b1-4371-bdad-55d9b7da7ec9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.604723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8058b82c67604a53bb2fa62eda08f59a', 'request_id': 'req-8a528584-65b1-4371-bdad-55d9b7da7ec9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.616924 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] The token cache is being invalidate because project 8058b82c67604a53bb2fa62eda08f59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:57.617266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.617924 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.619553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 905/1805] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:57 2022] DELETE /identity/v3/projects/8058b82c67604a53bb2fa62eda08f59a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:57.623395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:57.624833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:57.687754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd0252c99c749a0b433525d69de24ec'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.697829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a528584-65b1-4371-bdad-55d9b7da7ec9 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:57.702722 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:57.703590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:57.703898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:57.704186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] PATH_INFO: `/v3/users/4acc792578d348d8ba13987007935b67` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:57.705427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=4acc792578d348d8ba13987007935b67)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:57.707473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:57.764402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd0252c99c749a0b433525d69de24ec'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.777026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd0252c99c749a0b433525d69de24ec'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.778461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd0252c99c749a0b433525d69de24ec'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.785407 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8d3a0c4a-ae7f-4951-ae7c-fe1cd69b316d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd0252c99c749a0b433525d69de24ec'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.792053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 901/1806] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:57 2022] DELETE /identity/v3/users/4cd0252c99c749a0b433525d69de24ec => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:57.796603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b981e0-d5a1-4a06-8bf0-609f70c43fb3 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:57.796938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b981e0-d5a1-4a06-8bf0-609f70c43fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:57.797223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b981e0-d5a1-4a06-8bf0-609f70c43fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:57.816653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-23b981e0-d5a1-4a06-8bf0-609f70c43fb3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:57.818191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-23b981e0-d5a1-4a06-8bf0-609f70c43fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:57.853328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4acc792578d348d8ba13987007935b67'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.882870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 902/1807] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:57.895333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b981e0-d5a1-4a06-8bf0-609f70c43fb3 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:57.897342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-23b981e0-d5a1-4a06-8bf0-609f70c43fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:57.929188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4acc792578d348d8ba13987007935b67'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.942121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4acc792578d348d8ba13987007935b67'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.943851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4acc792578d348d8ba13987007935b67'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.950849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4acc792578d348d8ba13987007935b67'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:57.952552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b981e0-d5a1-4a06-8bf0-609f70c43fb3 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:57.956396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bfed7-6372-4bd2-ae93-373bda70b250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:57.956811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 906/1808] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:57 2022] DELETE /identity/v3/users/4acc792578d348d8ba13987007935b67 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:20:57.957115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bfed7-6372-4bd2-ae93-373bda70b250 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:57.957438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bfed7-6372-4bd2-ae93-373bda70b250 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:57.957791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bfed7-6372-4bd2-ae93-373bda70b250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:57.960832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a23bfed7-6372-4bd2-ae93-373bda70b250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:57.973065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bfed7-6372-4bd2-ae93-373bda70b250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:57.974580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bfed7-6372-4bd2-ae93-373bda70b250 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:57.983964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 903/1809] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:20:58.457066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:58.628874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:58.630403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:58.663168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:58.669823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bfed7-6372-4bd2-ae93-373bda70b250 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:58.669823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a23bfed7-6372-4bd2-ae93-373bda70b250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:58.678506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bfed7-6372-4bd2-ae93-373bda70b250 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:58.716234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b96da-714e-42d3-ae58-79b7ce7bb5ca admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:58.722910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:58.725328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:58.725619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:58.725900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] PATH_INFO: `/v3/projects/6c4f69786a2542088b0613d7af475d75` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:58.727139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4f69786a2542088b0613d7af475d75)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:58.729290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:58.758458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:58.759616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:58.759930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:58.760347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] PATH_INFO: `/v3/projects/7a1d5bb8656c4d9b84000573aff422e0` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:58.761576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1d5bb8656c4d9b84000573aff422e0)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:58.763485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:58.823482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4f69786a2542088b0613d7af475d75', 'request_id': 'req-595e9e49-74b6-45fc-aed0-89db5e943dc7'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:58.830453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4f69786a2542088b0613d7af475d75', 'request_id': 'req-595e9e49-74b6-45fc-aed0-89db5e943dc7'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:58.873971 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1d5bb8656c4d9b84000573aff422e0', 'request_id': 'req-cead21e4-c76b-4b69-bafb-8511cd54d92d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:58.880689 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1d5bb8656c4d9b84000573aff422e0', 'request_id': 'req-cead21e4-c76b-4b69-bafb-8511cd54d92d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:58.936249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4f69786a2542088b0613d7af475d75', 'request_id': 'req-595e9e49-74b6-45fc-aed0-89db5e943dc7'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:58.949902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] The token cache is being invalidate because project 6c4f69786a2542088b0613d7af475d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:58.950192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:58.951011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:58.952907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 907/1810] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:58 2022] DELETE /identity/v3/projects/6c4f69786a2542088b0613d7af475d75 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:58.957001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:58.959246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:58.993561 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1d5bb8656c4d9b84000573aff422e0', 'request_id': 'req-cead21e4-c76b-4b69-bafb-8511cd54d92d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:59.006125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] The token cache is being invalidate because project 7a1d5bb8656c4d9b84000573aff422e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:20:59.006728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:59.007750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cead21e4-c76b-4b69-bafb-8511cd54d92d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:59.013440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 904/1811] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:58 2022] DELETE /identity/v3/projects/7a1d5bb8656c4d9b84000573aff422e0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:20:59.015324 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fcae5-d78c-4119-a032-4b5d47d283f9 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:59.015817 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fcae5-d78c-4119-a032-4b5d47d283f9 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:59.016311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fcae5-d78c-4119-a032-4b5d47d283f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:59.030772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e9e49-74b6-45fc-aed0-89db5e943dc7 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:59.038026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-249fcae5-d78c-4119-a032-4b5d47d283f9 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:59.039508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-249fcae5-d78c-4119-a032-4b5d47d283f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:59.090301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:59.091199 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:59.091485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:59.091763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] PATH_INFO: `/v3/users/a420fab5425e4d50bb72cbe2f5000672` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:59.093122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a420fab5425e4d50bb72cbe2f5000672)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:59.095060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:59.109027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 905/1812] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:59.117230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00331f6-52bb-4f7e-8837-24f2b3f6d96b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:59.117519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00331f6-52bb-4f7e-8837-24f2b3f6d96b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:59.117800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00331f6-52bb-4f7e-8837-24f2b3f6d96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:59.136156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a00331f6-52bb-4f7e-8837-24f2b3f6d96b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:59.137322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a00331f6-52bb-4f7e-8837-24f2b3f6d96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:59.145167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 906/1813] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:20:59.149220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00331f6-52bb-4f7e-8837-24f2b3f6d96b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:59.157909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00331f6-52bb-4f7e-8837-24f2b3f6d96b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:59.168864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2176781-8a39-4ad6-a73c-5a79768d7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:59.169534 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176781-8a39-4ad6-a73c-5a79768d7933 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:59.169824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176781-8a39-4ad6-a73c-5a79768d7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:59.170120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176781-8a39-4ad6-a73c-5a79768d7933 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:59.171209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2176781-8a39-4ad6-a73c-5a79768d7933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:20:59.171517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2176781-8a39-4ad6-a73c-5a79768d7933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:59.173147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2176781-8a39-4ad6-a73c-5a79768d7933 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:59.186989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 907/1814] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:20:59.190363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2176781-8a39-4ad6-a73c-5a79768d7933 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:59.200653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2176781-8a39-4ad6-a73c-5a79768d7933 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:59.205395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43976825-e093-49d9-9eed-e87ce95a6687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:59.206079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43976825-e093-49d9-9eed-e87ce95a6687 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:59.206366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43976825-e093-49d9-9eed-e87ce95a6687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:59.206649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43976825-e093-49d9-9eed-e87ce95a6687 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:59.207338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43976825-e093-49d9-9eed-e87ce95a6687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:59.210470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43976825-e093-49d9-9eed-e87ce95a6687 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:59.326992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a420fab5425e4d50bb72cbe2f5000672'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:59.332953 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 908/1815] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:59 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:20:59.336731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43976825-e093-49d9-9eed-e87ce95a6687 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:59.413156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43976825-e093-49d9-9eed-e87ce95a6687 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:59.419285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a420fab5425e4d50bb72cbe2f5000672'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:59.419418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502180ad-c7c4-4421-8a88-9fd1e0e3c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:59.419839 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502180ad-c7c4-4421-8a88-9fd1e0e3c88b admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:59.420135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502180ad-c7c4-4421-8a88-9fd1e0e3c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:59.420473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502180ad-c7c4-4421-8a88-9fd1e0e3c88b admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:59.421178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502180ad-c7c4-4421-8a88-9fd1e0e3c88b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:59.423159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502180ad-c7c4-4421-8a88-9fd1e0e3c88b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:59.434537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a420fab5425e4d50bb72cbe2f5000672'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:59.435400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a420fab5425e4d50bb72cbe2f5000672'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:59.442928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a420fab5425e4d50bb72cbe2f5000672'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:20:59.449359 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 908/1816] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:20:58 2022] DELETE /identity/v3/users/a420fab5425e4d50bb72cbe2f5000672 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:59.548229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 909/1817] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:20:59 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:20:59.553061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:59.554896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:59.626093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76cf3e-1390-42ec-b7f4-2c6206bc55c3 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:59.630776 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab393c8-cabb-41ae-99ee-ac2301c92654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:59.631527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab393c8-cabb-41ae-99ee-ac2301c92654 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:59.631817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab393c8-cabb-41ae-99ee-ac2301c92654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:59.632133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab393c8-cabb-41ae-99ee-ac2301c92654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:59.632870 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab393c8-cabb-41ae-99ee-ac2301c92654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:59.635034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab393c8-cabb-41ae-99ee-ac2301c92654 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:59.646212 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 909/1818] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:20:59.650216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502180ad-c7c4-4421-8a88-9fd1e0e3c88b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:59.659854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502180ad-c7c4-4421-8a88-9fd1e0e3c88b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:59.665733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddb299-059f-420a-87ca-f394f41fef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:59.666400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddb299-059f-420a-87ca-f394f41fef99 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:59.666715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddb299-059f-420a-87ca-f394f41fef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:59.666991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddb299-059f-420a-87ca-f394f41fef99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:59.667719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddb299-059f-420a-87ca-f394f41fef99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:59.669344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddb299-059f-420a-87ca-f394f41fef99 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:59.683276 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 910/1819] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:20:59.684704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab393c8-cabb-41ae-99ee-ac2301c92654 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:59.694862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab393c8-cabb-41ae-99ee-ac2301c92654 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:20:59.699504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a702542-a915-4e32-ae63-2c0a38f148ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:20:59.700428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a702542-a915-4e32-ae63-2c0a38f148ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:59.700718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a702542-a915-4e32-ae63-2c0a38f148ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:59.701002 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a702542-a915-4e32-ae63-2c0a38f148ad admin admin] PATH_INFO: `/v3/projects/a429311dec834f85b201d08c927d71e2/users/7f5cee042c324929879eed0c4988393a/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:59.720919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a702542-a915-4e32-ae63-2c0a38f148ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a429311dec834f85b201d08c927d71e2, user_id=7f5cee042c324929879eed0c4988393a, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:20:59.724663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a702542-a915-4e32-ae63-2c0a38f148ad admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:20:59.771618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:59.799306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 910/1820] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:20:59 2022] PUT /identity/v3/projects/a429311dec834f85b201d08c927d71e2/users/7f5cee042c324929879eed0c4988393a/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:20:59.809891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f390f1-5338-45c7-af7e-8f523eec695f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:20:59.810451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f390f1-5338-45c7-af7e-8f523eec695f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:20:59.810841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f390f1-5338-45c7-af7e-8f523eec695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:20:59.841592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a8f390f1-5338-45c7-af7e-8f523eec695f None None] MFA Rules not processed for user `7f5cee042c324929879eed0c4988393a`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:20:59.843013 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a8f390f1-5338-45c7-af7e-8f523eec695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:20:59.903956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:20:59.920604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 911/1821] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:20:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:20:59.927311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a702542-a915-4e32-ae63-2c0a38f148ad admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:59.985379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f390f1-5338-45c7-af7e-8f523eec695f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:20:59.986960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a8f390f1-5338-45c7-af7e-8f523eec695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:00.018874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a702542-a915-4e32-ae63-2c0a38f148ad admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.028629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5980d-c2c0-4c85-b9fb-529a366615b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.029647 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5980d-c2c0-4c85-b9fb-529a366615b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.029926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5980d-c2c0-4c85-b9fb-529a366615b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.030346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5980d-c2c0-4c85-b9fb-529a366615b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.031071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5980d-c2c0-4c85-b9fb-529a366615b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.033133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5980d-c2c0-4c85-b9fb-529a366615b7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.075993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f390f1-5338-45c7-af7e-8f523eec695f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.077748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.078632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.078926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.079208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] PATH_INFO: `/v3/projects/052a2bc79665434ca8448f5384d1f530` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.080456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=052a2bc79665434ca8448f5384d1f530)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.082384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.165754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 911/1822] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:20:59 2022] POST /identity/v3/projects => generated 387 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:00.170695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5980d-c2c0-4c85-b9fb-529a366615b7 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.209377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052a2bc79665434ca8448f5384d1f530', 'request_id': 'req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:00.227618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052a2bc79665434ca8448f5384d1f530', 'request_id': 'req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:00.256117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5980d-c2c0-4c85-b9fb-529a366615b7 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.319742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f7eac-3172-4bcf-97c8-8219f463a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.320454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f7eac-3172-4bcf-97c8-8219f463a728 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.320737 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f7eac-3172-4bcf-97c8-8219f463a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.321008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f7eac-3172-4bcf-97c8-8219f463a728 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.321701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f7eac-3172-4bcf-97c8-8219f463a728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.323691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f7eac-3172-4bcf-97c8-8219f463a728 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.341314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052a2bc79665434ca8448f5384d1f530', 'request_id': 'req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:00.352800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] The token cache is being invalidate because project 052a2bc79665434ca8448f5384d1f530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:00.353084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:00.353766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fb874a3e-82f4-4b6b-8bbd-53325cce8d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:00.355375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 912/1823] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:20:59 2022] DELETE /identity/v3/projects/052a2bc79665434ca8448f5384d1f530 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:00.360343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ce0ee-8d64-48c9-956a-f5bce266328e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.360636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ce0ee-8d64-48c9-956a-f5bce266328e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.360918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ce0ee-8d64-48c9-956a-f5bce266328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.381865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0f9ce0ee-8d64-48c9-956a-f5bce266328e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:00.383094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0f9ce0ee-8d64-48c9-956a-f5bce266328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:00.399716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 913/1824] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:21:00.405780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc936f0c-b2e6-413b-bc1c-990dedefc2d1 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.406161 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc936f0c-b2e6-413b-bc1c-990dedefc2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.406506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc936f0c-b2e6-413b-bc1c-990dedefc2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.425236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-fc936f0c-b2e6-413b-bc1c-990dedefc2d1 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:00.426520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fc936f0c-b2e6-413b-bc1c-990dedefc2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:00.435022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 914/1825] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:21:00.440998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc936f0c-b2e6-413b-bc1c-990dedefc2d1 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.450878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 912/1826] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:00 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:00.452899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc936f0c-b2e6-413b-bc1c-990dedefc2d1 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.454723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f7eac-3172-4bcf-97c8-8219f463a728 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.456302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-721f7eac-3172-4bcf-97c8-8219f463a728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:00.457789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f07fb3-4432-4b8c-a604-bd141345d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.458489 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f07fb3-4432-4b8c-a604-bd141345d136 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.458780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f07fb3-4432-4b8c-a604-bd141345d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.459062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f07fb3-4432-4b8c-a604-bd141345d136 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.459865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f07fb3-4432-4b8c-a604-bd141345d136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:21:00.460234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f07fb3-4432-4b8c-a604-bd141345d136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.461837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f07fb3-4432-4b8c-a604-bd141345d136 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.468348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f7eac-3172-4bcf-97c8-8219f463a728 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.472983 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29215b7f-2d6b-4f55-bd5f-99c60add02b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.473671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29215b7f-2d6b-4f55-bd5f-99c60add02b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.473954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29215b7f-2d6b-4f55-bd5f-99c60add02b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.474228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29215b7f-2d6b-4f55-bd5f-99c60add02b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.474954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29215b7f-2d6b-4f55-bd5f-99c60add02b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.475910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 915/1827] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:21:00.476751 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29215b7f-2d6b-4f55-bd5f-99c60add02b4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.479721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f07fb3-4432-4b8c-a604-bd141345d136 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.487470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 913/1828] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:21:00.490144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f07fb3-4432-4b8c-a604-bd141345d136 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.491809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29215b7f-2d6b-4f55-bd5f-99c60add02b4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.494884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd96de-7bd7-43d5-ae01-f23bb3bda113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.495633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd96de-7bd7-43d5-ae01-f23bb3bda113 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.495943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd96de-7bd7-43d5-ae01-f23bb3bda113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.496218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd96de-7bd7-43d5-ae01-f23bb3bda113 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.496895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd96de-7bd7-43d5-ae01-f23bb3bda113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.498779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd96de-7bd7-43d5-ae01-f23bb3bda113 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.501401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29215b7f-2d6b-4f55-bd5f-99c60add02b4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.506830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da29b9-042b-4fc7-b699-f0fa7975fcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.507495 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da29b9-042b-4fc7-b699-f0fa7975fcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.507841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da29b9-042b-4fc7-b699-f0fa7975fcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.508153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da29b9-042b-4fc7-b699-f0fa7975fcc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.508881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da29b9-042b-4fc7-b699-f0fa7975fcc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.510547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da29b9-042b-4fc7-b699-f0fa7975fcc2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.521324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 914/1829] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:21:00.525565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da29b9-042b-4fc7-b699-f0fa7975fcc2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.535149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da29b9-042b-4fc7-b699-f0fa7975fcc2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.540107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f72435-f74d-4fb7-a511-d339e745f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.540966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f72435-f74d-4fb7-a511-d339e745f089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.541244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f72435-f74d-4fb7-a511-d339e745f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.541516 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f72435-f74d-4fb7-a511-d339e745f089 admin admin] PATH_INFO: `/v3/projects/e00cf498a36245819e014f764822bee5/users/6e65c3bab7f84e78a6eff2e5e7a0c6a8/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.555847 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f72435-f74d-4fb7-a511-d339e745f089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00cf498a36245819e014f764822bee5, user_id=6e65c3bab7f84e78a6eff2e5e7a0c6a8, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.558544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f72435-f74d-4fb7-a511-d339e745f089 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.613588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 916/1830] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:00 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:00.618703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd96de-7bd7-43d5-ae01-f23bb3bda113 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.639302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:00.661986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 915/1831] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:00 2022] PUT /identity/v3/projects/e00cf498a36245819e014f764822bee5/users/6e65c3bab7f84e78a6eff2e5e7a0c6a8/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:00.673896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1017f-513f-4f1b-8cc9-6a3941046534 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.674135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1017f-513f-4f1b-8cc9-6a3941046534 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.674383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1017f-513f-4f1b-8cc9-6a3941046534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.690974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd96de-7bd7-43d5-ae01-f23bb3bda113 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.713682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-2bb1017f-513f-4f1b-8cc9-6a3941046534 None None] MFA Rules not processed for user `6e65c3bab7f84e78a6eff2e5e7a0c6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:00.714906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2bb1017f-513f-4f1b-8cc9-6a3941046534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:00.760041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480fe1d-b541-44cb-8db6-5eb3c61344ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.761257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480fe1d-b541-44cb-8db6-5eb3c61344ea admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.762078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480fe1d-b541-44cb-8db6-5eb3c61344ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.762340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480fe1d-b541-44cb-8db6-5eb3c61344ea admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.763133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480fe1d-b541-44cb-8db6-5eb3c61344ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.765686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480fe1d-b541-44cb-8db6-5eb3c61344ea admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.797762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 916/1832] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:21:00.802735 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1017f-513f-4f1b-8cc9-6a3941046534 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.813560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1017f-513f-4f1b-8cc9-6a3941046534 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.818373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da398e14-1f71-491a-8737-e7094cb43758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.819041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da398e14-1f71-491a-8737-e7094cb43758 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.819326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da398e14-1f71-491a-8737-e7094cb43758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.819599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da398e14-1f71-491a-8737-e7094cb43758 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.820600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da398e14-1f71-491a-8737-e7094cb43758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.823637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da398e14-1f71-491a-8737-e7094cb43758 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.951999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 917/1833] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:00 2022] POST /identity/v3/users => generated 284 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:00.951999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480fe1d-b541-44cb-8db6-5eb3c61344ea admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.961638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480fe1d-b541-44cb-8db6-5eb3c61344ea admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:00.966735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f9972-e00a-4ac8-9a8c-00f6c59e33d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:00.967403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f9972-e00a-4ac8-9a8c-00f6c59e33d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:00.967687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f9972-e00a-4ac8-9a8c-00f6c59e33d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:00.968022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f9972-e00a-4ac8-9a8c-00f6c59e33d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:00.968775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f9972-e00a-4ac8-9a8c-00f6c59e33d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:00.970398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f9972-e00a-4ac8-9a8c-00f6c59e33d6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:00.981014 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 918/1834] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:21:00.985586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f9972-e00a-4ac8-9a8c-00f6c59e33d6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.991012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 917/1835] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:00 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:00.995015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da398e14-1f71-491a-8737-e7094cb43758 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:00.996725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f9972-e00a-4ac8-9a8c-00f6c59e33d6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:01.052845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd81a3-d61f-4ab4-8863-26f1bb039263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:01.053561 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd81a3-d61f-4ab4-8863-26f1bb039263 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.053855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd81a3-d61f-4ab4-8863-26f1bb039263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.054147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd81a3-d61f-4ab4-8863-26f1bb039263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.054861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd81a3-d61f-4ab4-8863-26f1bb039263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:01.056523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd81a3-d61f-4ab4-8863-26f1bb039263 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:01.058889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da398e14-1f71-491a-8737-e7094cb43758 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:01.062564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf95a3d-2f38-4844-b273-131008f8c442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:01.063281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf95a3d-2f38-4844-b273-131008f8c442 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.063569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf95a3d-2f38-4844-b273-131008f8c442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.063845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf95a3d-2f38-4844-b273-131008f8c442 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.064574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf95a3d-2f38-4844-b273-131008f8c442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:01.066524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf95a3d-2f38-4844-b273-131008f8c442 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:01.067135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 919/1836] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:01.071394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd81a3-d61f-4ab4-8863-26f1bb039263 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:01.084282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd81a3-d61f-4ab4-8863-26f1bb039263 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:01.089516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98ee6b-f3e3-414d-b2dc-86c523aaeadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:01.090467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98ee6b-f3e3-414d-b2dc-86c523aaeadd admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.090757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98ee6b-f3e3-414d-b2dc-86c523aaeadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.091024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98ee6b-f3e3-414d-b2dc-86c523aaeadd admin admin] PATH_INFO: `/v3/projects/b9b8cd96b2dd42e4b77150b2b309c39f/users/d0f37db2243443a5be4aad3f46a83e12/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.107223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98ee6b-f3e3-414d-b2dc-86c523aaeadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b8cd96b2dd42e4b77150b2b309c39f, user_id=d0f37db2243443a5be4aad3f46a83e12, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:01.109965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98ee6b-f3e3-414d-b2dc-86c523aaeadd admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:01.193331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 918/1837] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:00 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:01.197373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf95a3d-2f38-4844-b273-131008f8c442 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:01.207269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf95a3d-2f38-4844-b273-131008f8c442 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:01.214057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215507b-3d63-4a4d-86e4-3f5a779486cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:01.214811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215507b-3d63-4a4d-86e4-3f5a779486cb admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.215100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215507b-3d63-4a4d-86e4-3f5a779486cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.215423 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215507b-3d63-4a4d-86e4-3f5a779486cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.216200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215507b-3d63-4a4d-86e4-3f5a779486cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:01.217509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 920/1838] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:01 2022] PUT /identity/v3/projects/b9b8cd96b2dd42e4b77150b2b309c39f/users/d0f37db2243443a5be4aad3f46a83e12/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:01.217821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215507b-3d63-4a4d-86e4-3f5a779486cb admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:01.229269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 919/1839] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:21:01.230439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105da84-aa2c-4e53-935c-6de8f70ee8cb None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.230740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105da84-aa2c-4e53-935c-6de8f70ee8cb None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.231025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105da84-aa2c-4e53-935c-6de8f70ee8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.233366 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215507b-3d63-4a4d-86e4-3f5a779486cb admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:01.242940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215507b-3d63-4a4d-86e4-3f5a779486cb admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:01.256557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-8105da84-aa2c-4e53-935c-6de8f70ee8cb None None] MFA Rules not processed for user `d0f37db2243443a5be4aad3f46a83e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:01.257762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-8105da84-aa2c-4e53-935c-6de8f70ee8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:01.297801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8b437-b1da-4477-baff-663c0631df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:01.299012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8b437-b1da-4477-baff-663c0631df16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.299465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8b437-b1da-4477-baff-663c0631df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.299862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8b437-b1da-4477-baff-663c0631df16 admin admin] PATH_INFO: `/v3/projects/678127303b9046e386fc530f8c24387e/users/7881b9da3b9744e69dd5cae9ab95a50f/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.318809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8b437-b1da-4477-baff-663c0631df16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=678127303b9046e386fc530f8c24387e, user_id=7881b9da3b9744e69dd5cae9ab95a50f, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:01.321229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 921/1840] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:21:01.321624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8b437-b1da-4477-baff-663c0631df16 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:01.325577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105da84-aa2c-4e53-935c-6de8f70ee8cb None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:01.336893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105da84-aa2c-4e53-935c-6de8f70ee8cb None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:01.341744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb40c6c-0cc8-406f-b8f8-686eb0e8303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:01.342400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb40c6c-0cc8-406f-b8f8-686eb0e8303b admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.342682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb40c6c-0cc8-406f-b8f8-686eb0e8303b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.342957 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb40c6c-0cc8-406f-b8f8-686eb0e8303b admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.343695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb40c6c-0cc8-406f-b8f8-686eb0e8303b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:01.345620 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb40c6c-0cc8-406f-b8f8-686eb0e8303b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:01.463534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 920/1841] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:01 2022] PUT /identity/v3/projects/678127303b9046e386fc530f8c24387e/users/7881b9da3b9744e69dd5cae9ab95a50f/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:01.469095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8b437-b1da-4477-baff-663c0631df16 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:01.507182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 922/1842] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:01 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:01.512824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb40c6c-0cc8-406f-b8f8-686eb0e8303b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:01.590084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8b437-b1da-4477-baff-663c0631df16 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:01.593453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:01.650093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb40c6c-0cc8-406f-b8f8-686eb0e8303b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:01.655725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc0db5-0077-4025-9d6f-18c4a4f1760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:01.656739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc0db5-0077-4025-9d6f-18c4a4f1760d admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.657130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc0db5-0077-4025-9d6f-18c4a4f1760d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.657517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc0db5-0077-4025-9d6f-18c4a4f1760d admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.658324 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc0db5-0077-4025-9d6f-18c4a4f1760d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:01.661527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc0db5-0077-4025-9d6f-18c4a4f1760d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:01.663709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:01.678904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e289340-9fd1-4900-af9e-3426bbd45906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:01.679597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289340-9fd1-4900-af9e-3426bbd45906 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.679881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289340-9fd1-4900-af9e-3426bbd45906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.680182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289340-9fd1-4900-af9e-3426bbd45906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.680921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e289340-9fd1-4900-af9e-3426bbd45906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:01.682535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e289340-9fd1-4900-af9e-3426bbd45906 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:01.693380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 921/1843] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:21:01.701776 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e289340-9fd1-4900-af9e-3426bbd45906 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:01.706992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e289340-9fd1-4900-af9e-3426bbd45906 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:01.712417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51c21d-e891-4989-a239-e9d622811bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:01.713630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51c21d-e891-4989-a239-e9d622811bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.713860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51c21d-e891-4989-a239-e9d622811bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.714141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51c21d-e891-4989-a239-e9d622811bad admin admin] PATH_INFO: `/v3/projects/678127303b9046e386fc530f8c24387e/users/7881b9da3b9744e69dd5cae9ab95a50f/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.716335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51c21d-e891-4989-a239-e9d622811bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=678127303b9046e386fc530f8c24387e, user_id=7881b9da3b9744e69dd5cae9ab95a50f, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:01.719030 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51c21d-e891-4989-a239-e9d622811bad admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:01.729919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 922/1844] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:01 2022] PUT /identity/v3/projects/678127303b9046e386fc530f8c24387e/users/7881b9da3b9744e69dd5cae9ab95a50f/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:01.739930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2505b-1a9c-447c-a514-c15cc453398b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.740309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2505b-1a9c-447c-a514-c15cc453398b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.740506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2505b-1a9c-447c-a514-c15cc453398b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.767843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7da2505b-1a9c-447c-a514-c15cc453398b None None] MFA Rules not processed for user `7881b9da3b9744e69dd5cae9ab95a50f`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:01.769358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7da2505b-1a9c-447c-a514-c15cc453398b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:01.832390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 923/1845] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:01 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:01.838523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc0db5-0077-4025-9d6f-18c4a4f1760d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:01.851610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc0db5-0077-4025-9d6f-18c4a4f1760d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:01.852334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 923/1846] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:21:01.863565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2505b-1a9c-447c-a514-c15cc453398b None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:01.865870 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7da2505b-1a9c-447c-a514-c15cc453398b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:01.980042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72ac64-f5dc-4ced-ab39-0099bcaaa71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:01.980801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72ac64-f5dc-4ced-ab39-0099bcaaa71a admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:01.981193 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72ac64-f5dc-4ced-ab39-0099bcaaa71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:01.981570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72ac64-f5dc-4ced-ab39-0099bcaaa71a admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:01.982795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72ac64-f5dc-4ced-ab39-0099bcaaa71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:01.985011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72ac64-f5dc-4ced-ab39-0099bcaaa71a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:01.998710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 924/1847] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:21:02.002513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72ac64-f5dc-4ced-ab39-0099bcaaa71a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:02.007065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2505b-1a9c-447c-a514-c15cc453398b None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:02.012675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ba325-706b-45f0-9183-ae569c519ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:02.013771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ba325-706b-45f0-9183-ae569c519ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:02.014021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72ac64-f5dc-4ced-ab39-0099bcaaa71a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:02.014299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ba325-706b-45f0-9183-ae569c519ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:02.014676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ba325-706b-45f0-9183-ae569c519ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:02.019142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009778-f5c4-4156-9ffa-a39acacdb63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:02.020023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009778-f5c4-4156-9ffa-a39acacdb63a admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:02.020339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009778-f5c4-4156-9ffa-a39acacdb63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:02.020628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009778-f5c4-4156-9ffa-a39acacdb63a admin admin] PATH_INFO: `/v3/projects/b8e7126605a04f50ac31745bc966c0dd/users/fa42ad6c6dd5487a95a6c1dcfca278b0/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:02.033374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ba325-706b-45f0-9183-ae569c519ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:02.035596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ba325-706b-45f0-9183-ae569c519ea7 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:02.040624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03009778-f5c4-4156-9ffa-a39acacdb63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e7126605a04f50ac31745bc966c0dd, user_id=fa42ad6c6dd5487a95a6c1dcfca278b0, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:02.044387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03009778-f5c4-4156-9ffa-a39acacdb63a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:02.049127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 924/1848] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:02.141932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 925/1849] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:02 2022] PUT /identity/v3/projects/b8e7126605a04f50ac31745bc966c0dd/users/fa42ad6c6dd5487a95a6c1dcfca278b0/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:02.145389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ba325-706b-45f0-9183-ae569c519ea7 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:02.159857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ba325-706b-45f0-9183-ae569c519ea7 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:02.288711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed6d48-7cca-4822-a279-14502b4be195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:02.289788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed6d48-7cca-4822-a279-14502b4be195 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:02.290149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed6d48-7cca-4822-a279-14502b4be195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:02.290491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed6d48-7cca-4822-a279-14502b4be195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:02.291346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed6d48-7cca-4822-a279-14502b4be195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:02.293344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed6d48-7cca-4822-a279-14502b4be195 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:02.329174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 925/1850] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:02.336789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009778-f5c4-4156-9ffa-a39acacdb63a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:02.349757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009778-f5c4-4156-9ffa-a39acacdb63a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:02.356504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bf5d6-9ff5-405a-ba08-c458f37c2c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:02.357755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bf5d6-9ff5-405a-ba08-c458f37c2c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:02.358592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bf5d6-9ff5-405a-ba08-c458f37c2c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:02.363143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bf5d6-9ff5-405a-ba08-c458f37c2c0c admin admin] PATH_INFO: `/v3/projects/b8e7126605a04f50ac31745bc966c0dd/users/fa42ad6c6dd5487a95a6c1dcfca278b0/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:02.363143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bf5d6-9ff5-405a-ba08-c458f37c2c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e7126605a04f50ac31745bc966c0dd, user_id=fa42ad6c6dd5487a95a6c1dcfca278b0, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:02.367244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bf5d6-9ff5-405a-ba08-c458f37c2c0c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:02.380698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 926/1851] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:02 2022] PUT /identity/v3/projects/b8e7126605a04f50ac31745bc966c0dd/users/fa42ad6c6dd5487a95a6c1dcfca278b0/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:02.391543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1e46-280a-49da-95de-eeefe1d9de4d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:02.394886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1e46-280a-49da-95de-eeefe1d9de4d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:02.394886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1e46-280a-49da-95de-eeefe1d9de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:02.438116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-b57e1e46-280a-49da-95de-eeefe1d9de4d None None] MFA Rules not processed for user `fa42ad6c6dd5487a95a6c1dcfca278b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:02.441802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b57e1e46-280a-49da-95de-eeefe1d9de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:02.564705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 926/1852] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:02.595777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bf5d6-9ff5-405a-ba08-c458f37c2c0c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:02.598135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cb9bf5d6-9ff5-405a-ba08-c458f37c2c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:02.698277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bf5d6-9ff5-405a-ba08-c458f37c2c0c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:02.702096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47615a66-2db3-41b9-a6b6-6da7876e0868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:02.702959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615a66-2db3-41b9-a6b6-6da7876e0868 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:02.703437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615a66-2db3-41b9-a6b6-6da7876e0868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:02.703721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615a66-2db3-41b9-a6b6-6da7876e0868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:02.714139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47615a66-2db3-41b9-a6b6-6da7876e0868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:02.715574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47615a66-2db3-41b9-a6b6-6da7876e0868 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:02.726949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 927/1853] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:02.890901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:02.928171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1e46-280a-49da-95de-eeefe1d9de4d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:02.945853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1e46-280a-49da-95de-eeefe1d9de4d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:02.950862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b48553-fa49-474c-8f43-ea49ad8195fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:02.951549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b48553-fa49-474c-8f43-ea49ad8195fa service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:02.951837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b48553-fa49-474c-8f43-ea49ad8195fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:02.952147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b48553-fa49-474c-8f43-ea49ad8195fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:03.025084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b48553-fa49-474c-8f43-ea49ad8195fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:03.027004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b48553-fa49-474c-8f43-ea49ad8195fa service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:03.031881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:03.037795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 927/1854] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:03.983102 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47615a66-2db3-41b9-a6b6-6da7876e0868 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:03.995004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47615a66-2db3-41b9-a6b6-6da7876e0868 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:03.999716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d208ac-1cfe-4bde-b233-01fe9ea29f0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:04.000923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d208ac-1cfe-4bde-b233-01fe9ea29f0e service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:04.001356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d208ac-1cfe-4bde-b233-01fe9ea29f0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:04.004795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d208ac-1cfe-4bde-b233-01fe9ea29f0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:04.004795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e7d208ac-1cfe-4bde-b233-01fe9ea29f0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:04.108458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d208ac-1cfe-4bde-b233-01fe9ea29f0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:04.110365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d208ac-1cfe-4bde-b233-01fe9ea29f0e service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:04.120476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 928/1855] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:04.741784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:05.577018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:05.792687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:07.024530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b48553-fa49-474c-8f43-ea49ad8195fa service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:07.026004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-14b48553-fa49-474c-8f43-ea49ad8195fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:07.120293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b48553-fa49-474c-8f43-ea49ad8195fa service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:07.125452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:07.126559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:07.126851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:07.127129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] PATH_INFO: `/v3/users/e227e16aaad54e12972e81cba41cf169` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:07.128413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e227e16aaad54e12972e81cba41cf169)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:07.130965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:07.344804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e227e16aaad54e12972e81cba41cf169'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:07.433157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e227e16aaad54e12972e81cba41cf169'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:07.446464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e227e16aaad54e12972e81cba41cf169'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:07.447287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e227e16aaad54e12972e81cba41cf169'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:07.454222 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e227e16aaad54e12972e81cba41cf169'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:07.460941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 928/1856] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:07 2022] DELETE /identity/v3/users/e227e16aaad54e12972e81cba41cf169 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:07.466469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8eca5-99d6-4c1f-8ce4-f92390392f05 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:07.467220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8eca5-99d6-4c1f-8ce4-f92390392f05 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:07.467220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8eca5-99d6-4c1f-8ce4-f92390392f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:07.485824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-03a8eca5-99d6-4c1f-8ce4-f92390392f05 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:07.487312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-03a8eca5-99d6-4c1f-8ce4-f92390392f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:07.560296 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 929/1857] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:07.576800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:07.578508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:07.644076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07a0d2-3830-4068-afc2-93d5f4b2b24c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:07.648673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aaca8-8439-45e5-88b3-8fed7c8673a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:07.649358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aaca8-8439-45e5-88b3-8fed7c8673a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:07.649775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aaca8-8439-45e5-88b3-8fed7c8673a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:07.650054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aaca8-8439-45e5-88b3-8fed7c8673a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:07.660167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aaca8-8439-45e5-88b3-8fed7c8673a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:07.661687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aaca8-8439-45e5-88b3-8fed7c8673a5 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:07.672514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 929/1858] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:08.330320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:08.330795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8eca5-99d6-4c1f-8ce4-f92390392f05 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:08.332375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-03a8eca5-99d6-4c1f-8ce4-f92390392f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:08.345280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8eca5-99d6-4c1f-8ce4-f92390392f05 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:08.350393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:08.351269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:08.351712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:08.352150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] PATH_INFO: `/v3/projects/c21abb4b62f548d7b98d65c4706fca5f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:08.353343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21abb4b62f548d7b98d65c4706fca5f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:08.358603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:08.462861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21abb4b62f548d7b98d65c4706fca5f', 'request_id': 'req-95867287-65eb-4ad4-8f0d-627dac6e700e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:08.469073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21abb4b62f548d7b98d65c4706fca5f', 'request_id': 'req-95867287-65eb-4ad4-8f0d-627dac6e700e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:08.569718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21abb4b62f548d7b98d65c4706fca5f', 'request_id': 'req-95867287-65eb-4ad4-8f0d-627dac6e700e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:08.582610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] The token cache is being invalidate because project c21abb4b62f548d7b98d65c4706fca5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:08.582911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:08.583625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:08.585353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 930/1859] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:08 2022] DELETE /identity/v3/projects/c21abb4b62f548d7b98d65c4706fca5f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:08.589460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aaca8-8439-45e5-88b3-8fed7c8673a5 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:08.598908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aaca8-8439-45e5-88b3-8fed7c8673a5 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:08.655690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:08.656607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:08.656892 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:08.657171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] PATH_INFO: `/v3/users/fdff9a3202c8423c9c0120ea71052150` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:08.658364 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdff9a3202c8423c9c0120ea71052150)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:08.660367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:08.737517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:08.739440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:08.746590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:08.758202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95867287-65eb-4ad4-8f0d-627dac6e700e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:08.764881 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:08.765762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:08.766049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:08.766328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] PATH_INFO: `/v3/users/d0f37db2243443a5be4aad3f46a83e12` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:08.767543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f37db2243443a5be4aad3f46a83e12)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:08.769504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:08.887141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdff9a3202c8423c9c0120ea71052150'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:08.985716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdff9a3202c8423c9c0120ea71052150'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:08.998599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdff9a3202c8423c9c0120ea71052150'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:08.999299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdff9a3202c8423c9c0120ea71052150'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.006142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-99f5f62d-a430-450a-bca8-88ae14458df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdff9a3202c8423c9c0120ea71052150'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.012176 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 930/1860] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:08 2022] DELETE /identity/v3/users/fdff9a3202c8423c9c0120ea71052150 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:09.039601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f37db2243443a5be4aad3f46a83e12'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.158351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f37db2243443a5be4aad3f46a83e12'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.172363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f37db2243443a5be4aad3f46a83e12'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.173038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f37db2243443a5be4aad3f46a83e12'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.180497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f37db2243443a5be4aad3f46a83e12'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.187192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 931/1861] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:08 2022] DELETE /identity/v3/users/d0f37db2243443a5be4aad3f46a83e12 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:09.193009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52606-ca03-4aa1-8d87-b31d8c29daf7 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:09.193362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52606-ca03-4aa1-8d87-b31d8c29daf7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:09.193724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52606-ca03-4aa1-8d87-b31d8c29daf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:09.211258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0fb52606-ca03-4aa1-8d87-b31d8c29daf7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:09.212505 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0fb52606-ca03-4aa1-8d87-b31d8c29daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:09.273796 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 931/1862] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:09.284133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:09.285552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:09.344944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf6fd0-c468-4698-b5fe-2c56289a0b40 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:09.349065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfec9bb-9a69-457e-a5b5-a1dfb882c94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:09.349744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfec9bb-9a69-457e-a5b5-a1dfb882c94e service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:09.350028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfec9bb-9a69-457e-a5b5-a1dfb882c94e service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:09.350302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfec9bb-9a69-457e-a5b5-a1dfb882c94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:09.359502 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfec9bb-9a69-457e-a5b5-a1dfb882c94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:09.360964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfec9bb-9a69-457e-a5b5-a1dfb882c94e service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:09.370267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 932/1863] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:09.508663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb52606-ca03-4aa1-8d87-b31d8c29daf7 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:09.510209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0fb52606-ca03-4aa1-8d87-b31d8c29daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:09.532248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb52606-ca03-4aa1-8d87-b31d8c29daf7 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:09.546049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:09.547298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:09.547415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:09.547662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] PATH_INFO: `/v3/projects/e31103ac08904031872559e3f6ea4c8e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:09.548941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31103ac08904031872559e3f6ea4c8e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:09.550874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:09.658884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31103ac08904031872559e3f6ea4c8e', 'request_id': 'req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.666209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31103ac08904031872559e3f6ea4c8e', 'request_id': 'req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.780198 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31103ac08904031872559e3f6ea4c8e', 'request_id': 'req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.793417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] The token cache is being invalidate because project e31103ac08904031872559e3f6ea4c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:09.793981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.794822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7da23dc-4e6a-442d-bbcf-fde3deed40cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:09.796588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 932/1864] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:09 2022] DELETE /identity/v3/projects/e31103ac08904031872559e3f6ea4c8e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:09.801708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e76f-6e18-4c48-9381-6755dd2d727e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:09.802517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e76f-6e18-4c48-9381-6755dd2d727e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:09.802953 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e76f-6e18-4c48-9381-6755dd2d727e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:09.823192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-cfc7e76f-6e18-4c48-9381-6755dd2d727e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:09.824444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cfc7e76f-6e18-4c48-9381-6755dd2d727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:09.889717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 933/1865] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:21:09.898345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19741a1-cf3b-4861-968c-d722b7aad408 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:09.904022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19741a1-cf3b-4861-968c-d722b7aad408 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:09.904022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19741a1-cf3b-4861-968c-d722b7aad408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:09.917738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-b19741a1-cf3b-4861-968c-d722b7aad408 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:09.918944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b19741a1-cf3b-4861-968c-d722b7aad408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:09.930739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 933/1866] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:09.931644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19741a1-cf3b-4861-968c-d722b7aad408 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:09.931781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e76f-6e18-4c48-9381-6755dd2d727e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:09.933140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cfc7e76f-6e18-4c48-9381-6755dd2d727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:09.944413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19741a1-cf3b-4861-968c-d722b7aad408 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:09.949224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8fbde-f0bc-418f-9d48-d29e992a5fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:09.949960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8fbde-f0bc-418f-9d48-d29e992a5fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:09.950314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8fbde-f0bc-418f-9d48-d29e992a5fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:09.950660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8fbde-f0bc-418f-9d48-d29e992a5fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:09.951462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8fbde-f0bc-418f-9d48-d29e992a5fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:21:09.951835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8fbde-f0bc-418f-9d48-d29e992a5fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:09.953591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8fbde-f0bc-418f-9d48-d29e992a5fd5 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:09.966498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e76f-6e18-4c48-9381-6755dd2d727e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:09.974070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 934/1867] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:21:09.974220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:09.974669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:09.974669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:09.974899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] PATH_INFO: `/v3/projects/b9b8cd96b2dd42e4b77150b2b309c39f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:09.975556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8fbde-f0bc-418f-9d48-d29e992a5fd5 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:09.976202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b8cd96b2dd42e4b77150b2b309c39f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:09.978457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:09.985850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8fbde-f0bc-418f-9d48-d29e992a5fd5 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:09.991867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182f73a-b05f-4832-a1d7-6eb8d8b0e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:09.992569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f73a-b05f-4832-a1d7-6eb8d8b0e157 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:09.992856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f73a-b05f-4832-a1d7-6eb8d8b0e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:09.993144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f73a-b05f-4832-a1d7-6eb8d8b0e157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:09.993835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182f73a-b05f-4832-a1d7-6eb8d8b0e157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:09.995749 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182f73a-b05f-4832-a1d7-6eb8d8b0e157 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:10.113154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b8cd96b2dd42e4b77150b2b309c39f', 'request_id': 'req-6b5c674d-7418-4775-b32b-114d22629018'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:10.119665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b8cd96b2dd42e4b77150b2b309c39f', 'request_id': 'req-6b5c674d-7418-4775-b32b-114d22629018'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:10.122357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 935/1868] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:09 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:10.126468 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182f73a-b05f-4832-a1d7-6eb8d8b0e157 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:10.186501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182f73a-b05f-4832-a1d7-6eb8d8b0e157 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:10.191181 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42bb13-4f1e-4f41-9bb6-2d41285905fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:10.192028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42bb13-4f1e-4f41-9bb6-2d41285905fb admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:10.192320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42bb13-4f1e-4f41-9bb6-2d41285905fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:10.192605 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42bb13-4f1e-4f41-9bb6-2d41285905fb admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:10.198480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42bb13-4f1e-4f41-9bb6-2d41285905fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:10.198480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42bb13-4f1e-4f41-9bb6-2d41285905fb admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:10.221284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b8cd96b2dd42e4b77150b2b309c39f', 'request_id': 'req-6b5c674d-7418-4775-b32b-114d22629018'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:10.232640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] The token cache is being invalidate because project b9b8cd96b2dd42e4b77150b2b309c39f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:10.232932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:10.233588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:10.235199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 934/1869] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:09 2022] DELETE /identity/v3/projects/b9b8cd96b2dd42e4b77150b2b309c39f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:10.238980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:10.240289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:10.302015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c674d-7418-4775-b32b-114d22629018 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:10.306699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:10.307572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:10.307860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:10.308171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] PATH_INFO: `/v3/users/fa42ad6c6dd5487a95a6c1dcfca278b0` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:10.309369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa42ad6c6dd5487a95a6c1dcfca278b0)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:10.311363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:10.321696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 936/1870] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:10 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:10.325834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42bb13-4f1e-4f41-9bb6-2d41285905fb admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:10.327602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7b42bb13-4f1e-4f41-9bb6-2d41285905fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:10.341036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42bb13-4f1e-4f41-9bb6-2d41285905fb admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:10.345768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4840e6-ae73-4b37-acf4-b1b4525321ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:10.346441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4840e6-ae73-4b37-acf4-b1b4525321ac admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:10.346747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4840e6-ae73-4b37-acf4-b1b4525321ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:10.347010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4840e6-ae73-4b37-acf4-b1b4525321ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:10.347743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4840e6-ae73-4b37-acf4-b1b4525321ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:10.350072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4840e6-ae73-4b37-acf4-b1b4525321ac admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:10.360224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 937/1871] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:10.363932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4840e6-ae73-4b37-acf4-b1b4525321ac admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:10.373798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4840e6-ae73-4b37-acf4-b1b4525321ac admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:10.378471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf95a0-db4c-451e-ba41-5aa2d77c09d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:10.379146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf95a0-db4c-451e-ba41-5aa2d77c09d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:10.379476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf95a0-db4c-451e-ba41-5aa2d77c09d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:10.379759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf95a0-db4c-451e-ba41-5aa2d77c09d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:10.380556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf95a0-db4c-451e-ba41-5aa2d77c09d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:10.382171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf95a0-db4c-451e-ba41-5aa2d77c09d7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:10.393267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 938/1872] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:21:10.397912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf95a0-db4c-451e-ba41-5aa2d77c09d7 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:10.407851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf95a0-db4c-451e-ba41-5aa2d77c09d7 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:10.413113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03f5c2-4fa0-4c34-8b34-4a2aafd908a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:10.414130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03f5c2-4fa0-4c34-8b34-4a2aafd908a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:10.414421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03f5c2-4fa0-4c34-8b34-4a2aafd908a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:10.414698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03f5c2-4fa0-4c34-8b34-4a2aafd908a1 admin admin] PATH_INFO: `/v3/projects/b97247e2dae049e0890954ae18eb0af6/users/ec360e4110884dda8a6bba70dd02b332/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:10.429426 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03f5c2-4fa0-4c34-8b34-4a2aafd908a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97247e2dae049e0890954ae18eb0af6, user_id=ec360e4110884dda8a6bba70dd02b332, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:10.432131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03f5c2-4fa0-4c34-8b34-4a2aafd908a1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:10.558535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 939/1873] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:10 2022] PUT /identity/v3/projects/b97247e2dae049e0890954ae18eb0af6/users/ec360e4110884dda8a6bba70dd02b332/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:10.569210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856a4ec-2433-4509-b348-5930f9a950e1 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:10.569494 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856a4ec-2433-4509-b348-5930f9a950e1 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:10.569771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856a4ec-2433-4509-b348-5930f9a950e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:10.597320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7856a4ec-2433-4509-b348-5930f9a950e1 None None] MFA Rules not processed for user `ec360e4110884dda8a6bba70dd02b332`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:10.598553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7856a4ec-2433-4509-b348-5930f9a950e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:10.662190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 940/1874] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:21:10.663406 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa42ad6c6dd5487a95a6c1dcfca278b0'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:10.666791 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856a4ec-2433-4509-b348-5930f9a950e1 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:10.726421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856a4ec-2433-4509-b348-5930f9a950e1 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:10.731128 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440f098-0a19-4ee4-91f6-dad6ec11a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:10.731790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f098-0a19-4ee4-91f6-dad6ec11a79a admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:10.732106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f098-0a19-4ee4-91f6-dad6ec11a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:10.732386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f098-0a19-4ee4-91f6-dad6ec11a79a admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:10.733079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440f098-0a19-4ee4-91f6-dad6ec11a79a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:10.735001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440f098-0a19-4ee4-91f6-dad6ec11a79a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:10.820892 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa42ad6c6dd5487a95a6c1dcfca278b0'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:10.834070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa42ad6c6dd5487a95a6c1dcfca278b0'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:10.834749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa42ad6c6dd5487a95a6c1dcfca278b0'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:10.842017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa42ad6c6dd5487a95a6c1dcfca278b0'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:10.848612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 935/1875] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:10 2022] DELETE /identity/v3/users/fa42ad6c6dd5487a95a6c1dcfca278b0 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:10.933699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 941/1876] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:10 2022] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:10.937599 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:10.939018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:11.003412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9ab47-2e2f-4ba0-a589-94798a664575 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:11.058523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd78a4-8b73-42a4-a6f2-b1a036b17e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:11.059242 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd78a4-8b73-42a4-a6f2-b1a036b17e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:11.059486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd78a4-8b73-42a4-a6f2-b1a036b17e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:11.059765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd78a4-8b73-42a4-a6f2-b1a036b17e1e admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:11.060498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd78a4-8b73-42a4-a6f2-b1a036b17e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:11.062596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd78a4-8b73-42a4-a6f2-b1a036b17e1e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:11.221063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 936/1877] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:10 2022] POST /identity/v3/users => generated 295 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:11.225395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440f098-0a19-4ee4-91f6-dad6ec11a79a admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:11.235762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440f098-0a19-4ee4-91f6-dad6ec11a79a admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:11.241226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda41d5e-8ca3-426f-86cf-533f39c1ddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:11.241984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda41d5e-8ca3-426f-86cf-533f39c1ddbb admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:11.242270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda41d5e-8ca3-426f-86cf-533f39c1ddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:11.242547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda41d5e-8ca3-426f-86cf-533f39c1ddbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:11.243274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda41d5e-8ca3-426f-86cf-533f39c1ddbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:11.244985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda41d5e-8ca3-426f-86cf-533f39c1ddbb admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:11.255416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 942/1878] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:11.259576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd78a4-8b73-42a4-a6f2-b1a036b17e1e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:11.269743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd78a4-8b73-42a4-a6f2-b1a036b17e1e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:11.274415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86542f3c-6379-4881-82d8-92cb0424c731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:11.275319 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86542f3c-6379-4881-82d8-92cb0424c731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:11.275604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86542f3c-6379-4881-82d8-92cb0424c731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:11.275974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86542f3c-6379-4881-82d8-92cb0424c731 admin admin] PATH_INFO: `/v3/projects/f01e7d1f04774a75a4c325aade5344a1/users/b981456fc5974e5fb31ef4bab75da843/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:11.293163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86542f3c-6379-4881-82d8-92cb0424c731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01e7d1f04774a75a4c325aade5344a1, user_id=b981456fc5974e5fb31ef4bab75da843, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:11.295813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86542f3c-6379-4881-82d8-92cb0424c731 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:11.438509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 937/1879] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:11 2022] PUT /identity/v3/projects/f01e7d1f04774a75a4c325aade5344a1/users/b981456fc5974e5fb31ef4bab75da843/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:11.442594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda41d5e-8ca3-426f-86cf-533f39c1ddbb admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:11.452520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda41d5e-8ca3-426f-86cf-533f39c1ddbb admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:11.492005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86542f3c-6379-4881-82d8-92cb0424c731 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:11.493804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-86542f3c-6379-4881-82d8-92cb0424c731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:11.508838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d2915-aa39-42cb-a526-d49a86b68a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:11.509519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d2915-aa39-42cb-a526-d49a86b68a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:11.509803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d2915-aa39-42cb-a526-d49a86b68a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:11.510075 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d2915-aa39-42cb-a526-d49a86b68a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:11.510800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d2915-aa39-42cb-a526-d49a86b68a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:11.512426 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d2915-aa39-42cb-a526-d49a86b68a57 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:11.522839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 943/1880] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:11.531287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d2915-aa39-42cb-a526-d49a86b68a57 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:11.541731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d2915-aa39-42cb-a526-d49a86b68a57 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:11.546561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11049e-34ca-4e62-b77f-464937efe416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:11.547478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11049e-34ca-4e62-b77f-464937efe416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:11.547760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11049e-34ca-4e62-b77f-464937efe416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:11.548064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11049e-34ca-4e62-b77f-464937efe416 admin admin] PATH_INFO: `/v3/projects/f01e7d1f04774a75a4c325aade5344a1/users/b981456fc5974e5fb31ef4bab75da843/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:11.550026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11049e-34ca-4e62-b77f-464937efe416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01e7d1f04774a75a4c325aade5344a1, user_id=b981456fc5974e5fb31ef4bab75da843, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:11.553269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11049e-34ca-4e62-b77f-464937efe416 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:11.562398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86542f3c-6379-4881-82d8-92cb0424c731 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:11.563714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 944/1881] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:11 2022] PUT /identity/v3/projects/f01e7d1f04774a75a4c325aade5344a1/users/b981456fc5974e5fb31ef4bab75da843/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:11.573691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c3802-b1f3-4094-99fc-902b2c70c5e6 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:11.576707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c3802-b1f3-4094-99fc-902b2c70c5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:11.576707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c3802-b1f3-4094-99fc-902b2c70c5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:11.601331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f57c3802-b1f3-4094-99fc-902b2c70c5e6 None None] MFA Rules not processed for user `b981456fc5974e5fb31ef4bab75da843`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:11.602532 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f57c3802-b1f3-4094-99fc-902b2c70c5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:11.625181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:11.626053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:11.626337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:11.626612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] PATH_INFO: `/v3/projects/b8e7126605a04f50ac31745bc966c0dd` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:11.627864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e7126605a04f50ac31745bc966c0dd)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:11.629804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:11.673408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 945/1882] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:21:11.684104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c3802-b1f3-4094-99fc-902b2c70c5e6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:11.685423 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f57c3802-b1f3-4094-99fc-902b2c70c5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:11.741038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c3802-b1f3-4094-99fc-902b2c70c5e6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:11.744598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f7a21-9dbc-4b37-ac06-7fe6c2fdcc89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:11.745306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f7a21-9dbc-4b37-ac06-7fe6c2fdcc89 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:11.745587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f7a21-9dbc-4b37-ac06-7fe6c2fdcc89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:11.745863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f7a21-9dbc-4b37-ac06-7fe6c2fdcc89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:11.747631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-462f7a21-9dbc-4b37-ac06-7fe6c2fdcc89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:11.803991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f7a21-9dbc-4b37-ac06-7fe6c2fdcc89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:11.805439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f7a21-9dbc-4b37-ac06-7fe6c2fdcc89 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:11.814598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 946/1883] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:21:11.820103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e7126605a04f50ac31745bc966c0dd', 'request_id': 'req-86c6438e-069a-4031-88ff-01aad49e1981'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:11.826652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e7126605a04f50ac31745bc966c0dd', 'request_id': 'req-86c6438e-069a-4031-88ff-01aad49e1981'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:11.843444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:11.969358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e7126605a04f50ac31745bc966c0dd', 'request_id': 'req-86c6438e-069a-4031-88ff-01aad49e1981'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:11.983461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] The token cache is being invalidate because project b8e7126605a04f50ac31745bc966c0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:11.983461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:11.983461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-86c6438e-069a-4031-88ff-01aad49e1981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:11.987746 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 938/1884] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:11 2022] DELETE /identity/v3/projects/b8e7126605a04f50ac31745bc966c0dd => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:11.989585 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835edf7-7ed2-48a6-9803-f1e1577e372a None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:11.989880 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835edf7-7ed2-48a6-9803-f1e1577e372a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:11.990160 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835edf7-7ed2-48a6-9803-f1e1577e372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:12.009173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-e835edf7-7ed2-48a6-9803-f1e1577e372a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:12.010326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e835edf7-7ed2-48a6-9803-f1e1577e372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:12.069793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 947/1885] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:12.077535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe95f0-a609-45c7-a948-ce95abbba390 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:12.077910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe95f0-a609-45c7-a948-ce95abbba390 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:12.078266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe95f0-a609-45c7-a948-ce95abbba390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:12.098924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0cbe95f0-a609-45c7-a948-ce95abbba390 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:12.100167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0cbe95f0-a609-45c7-a948-ce95abbba390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:12.108701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 939/1886] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:12.113117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835edf7-7ed2-48a6-9803-f1e1577e372a None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:12.122779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835edf7-7ed2-48a6-9803-f1e1577e372a None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:12.127537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391f54e-0f15-46dd-b59e-e69e55031c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:12.128234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391f54e-0f15-46dd-b59e-e69e55031c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:12.128548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391f54e-0f15-46dd-b59e-e69e55031c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:12.128940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391f54e-0f15-46dd-b59e-e69e55031c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:12.132695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391f54e-0f15-46dd-b59e-e69e55031c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:21:12.132695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391f54e-0f15-46dd-b59e-e69e55031c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:12.132695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391f54e-0f15-46dd-b59e-e69e55031c13 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:12.144753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 948/1887] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:21:12.149766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe95f0-a609-45c7-a948-ce95abbba390 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:12.158901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe95f0-a609-45c7-a948-ce95abbba390 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:12.163802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dc496-d971-46c3-8d2f-0df8e8f2e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:12.164578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dc496-d971-46c3-8d2f-0df8e8f2e1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:12.164933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dc496-d971-46c3-8d2f-0df8e8f2e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:12.165280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dc496-d971-46c3-8d2f-0df8e8f2e1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:12.166055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dc496-d971-46c3-8d2f-0df8e8f2e1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:12.168127 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dc496-d971-46c3-8d2f-0df8e8f2e1a8 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:12.359416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 940/1888] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:12 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:12.364444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391f54e-0f15-46dd-b59e-e69e55031c13 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:12.375306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391f54e-0f15-46dd-b59e-e69e55031c13 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:12.447459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569d25c-2e77-40df-bd77-51d36e9d45b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:12.448168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569d25c-2e77-40df-bd77-51d36e9d45b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:12.448454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569d25c-2e77-40df-bd77-51d36e9d45b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:12.448731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569d25c-2e77-40df-bd77-51d36e9d45b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:12.449459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569d25c-2e77-40df-bd77-51d36e9d45b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:12.451412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569d25c-2e77-40df-bd77-51d36e9d45b2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:12.569987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:12.613189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 949/1889] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:12 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:12.615805 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dc496-d971-46c3-8d2f-0df8e8f2e1a8 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:12.628475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dc496-d971-46c3-8d2f-0df8e8f2e1a8 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:12.633462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793a1f1-225d-4b49-89b0-cd7c9b4692ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:12.634108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a1f1-225d-4b49-89b0-cd7c9b4692ae admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:12.634393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a1f1-225d-4b49-89b0-cd7c9b4692ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:12.634673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a1f1-225d-4b49-89b0-cd7c9b4692ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:12.635397 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793a1f1-225d-4b49-89b0-cd7c9b4692ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:12.637113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793a1f1-225d-4b49-89b0-cd7c9b4692ae admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:12.648368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 941/1890] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:12.656175 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569d25c-2e77-40df-bd77-51d36e9d45b2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:12.672327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569d25c-2e77-40df-bd77-51d36e9d45b2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:12.673335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5904f-fc52-44bd-a829-bc50f54d5ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:12.674102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5904f-fc52-44bd-a829-bc50f54d5ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:12.674629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5904f-fc52-44bd-a829-bc50f54d5ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:12.674629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5904f-fc52-44bd-a829-bc50f54d5ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:12.675355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5904f-fc52-44bd-a829-bc50f54d5ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:12.677654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5904f-fc52-44bd-a829-bc50f54d5ad8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:12.688345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 950/1891] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:12.696505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793a1f1-225d-4b49-89b0-cd7c9b4692ae admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:12.706063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793a1f1-225d-4b49-89b0-cd7c9b4692ae admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:12.710482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dfe25-530d-42be-84a4-0a0fec392990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:12.711369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dfe25-530d-42be-84a4-0a0fec392990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:12.711640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dfe25-530d-42be-84a4-0a0fec392990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:12.712032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dfe25-530d-42be-84a4-0a0fec392990 admin admin] PATH_INFO: `/v3/projects/55de4ac52a3e4232928ffe054bee8beb/users/82a20b6e108d491fbce44bcd2df3480e/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:12.726618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dfe25-530d-42be-84a4-0a0fec392990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55de4ac52a3e4232928ffe054bee8beb, user_id=82a20b6e108d491fbce44bcd2df3480e, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:12.729298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dfe25-530d-42be-84a4-0a0fec392990 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:12.801001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 942/1892] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:12 2022] PUT /identity/v3/projects/55de4ac52a3e4232928ffe054bee8beb/users/82a20b6e108d491fbce44bcd2df3480e/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:12.812054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90f85d-1daf-4b81-8e8e-178ad9c2b577 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:12.812369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90f85d-1daf-4b81-8e8e-178ad9c2b577 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:12.812649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90f85d-1daf-4b81-8e8e-178ad9c2b577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:12.839101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-9e90f85d-1daf-4b81-8e8e-178ad9c2b577 None None] MFA Rules not processed for user `82a20b6e108d491fbce44bcd2df3480e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:12.840409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9e90f85d-1daf-4b81-8e8e-178ad9c2b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:12.901629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 951/1893] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:12.906311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dfe25-530d-42be-84a4-0a0fec392990 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:12.967570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dfe25-530d-42be-84a4-0a0fec392990 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:12.972242 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d38af-06d9-4a38-88f4-8664b10c6ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:12.973437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d38af-06d9-4a38-88f4-8664b10c6ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:12.973822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d38af-06d9-4a38-88f4-8664b10c6ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:12.974117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d38af-06d9-4a38-88f4-8664b10c6ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:12.974811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d38af-06d9-4a38-88f4-8664b10c6ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:12.976834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d38af-06d9-4a38-88f4-8664b10c6ad2 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:13.071148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 943/1894] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:12 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:13.072360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90f85d-1daf-4b81-8e8e-178ad9c2b577 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:13.083431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90f85d-1daf-4b81-8e8e-178ad9c2b577 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:13.142838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb6e7a-1d57-4f55-942a-c0324b44fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:13.143625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6e7a-1d57-4f55-942a-c0324b44fa27 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:13.144014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6e7a-1d57-4f55-942a-c0324b44fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:13.144369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6e7a-1d57-4f55-942a-c0324b44fa27 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:13.145637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb6e7a-1d57-4f55-942a-c0324b44fa27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:13.147602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb6e7a-1d57-4f55-942a-c0324b44fa27 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:13.282655 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 952/1895] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:13 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:13.283920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d38af-06d9-4a38-88f4-8664b10c6ad2 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:13.294657 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d38af-06d9-4a38-88f4-8664b10c6ad2 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:13.299300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db115033-e4fe-452a-ad4a-249783f9e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:13.307196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db115033-e4fe-452a-ad4a-249783f9e613 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:13.307196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db115033-e4fe-452a-ad4a-249783f9e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:13.307196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db115033-e4fe-452a-ad4a-249783f9e613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:13.307196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db115033-e4fe-452a-ad4a-249783f9e613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:13.307196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db115033-e4fe-452a-ad4a-249783f9e613 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:13.314248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 944/1896] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:13.318695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb6e7a-1d57-4f55-942a-c0324b44fa27 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:13.329480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb6e7a-1d57-4f55-942a-c0324b44fa27 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:13.335086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ba382-fe57-45d7-9617-1f43e7dbfd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:13.336017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ba382-fe57-45d7-9617-1f43e7dbfd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:13.340318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ba382-fe57-45d7-9617-1f43e7dbfd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:13.340318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ba382-fe57-45d7-9617-1f43e7dbfd75 admin admin] PATH_INFO: `/v3/projects/39624433ed7c49eab263c77b84852935/users/43a27b705cfb435ab8d3179dc9eb5c29/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:13.353384 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ba382-fe57-45d7-9617-1f43e7dbfd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39624433ed7c49eab263c77b84852935, user_id=43a27b705cfb435ab8d3179dc9eb5c29, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:13.356133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ba382-fe57-45d7-9617-1f43e7dbfd75 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:13.486713 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 953/1897] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:13 2022] PUT /identity/v3/projects/39624433ed7c49eab263c77b84852935/users/43a27b705cfb435ab8d3179dc9eb5c29/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:13.487732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db115033-e4fe-452a-ad4a-249783f9e613 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:13.497929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db115033-e4fe-452a-ad4a-249783f9e613 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:13.556252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c6132-dcef-4df2-b2ef-3c639d5f56cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:13.557067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c6132-dcef-4df2-b2ef-3c639d5f56cf admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:13.557428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c6132-dcef-4df2-b2ef-3c639d5f56cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:13.557702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c6132-dcef-4df2-b2ef-3c639d5f56cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:13.558420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c6132-dcef-4df2-b2ef-3c639d5f56cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:13.560035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c6132-dcef-4df2-b2ef-3c639d5f56cf admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:13.570621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 945/1898] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:13.575227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ba382-fe57-45d7-9617-1f43e7dbfd75 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:13.585725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ba382-fe57-45d7-9617-1f43e7dbfd75 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:13.590904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c7adf-158b-45ed-8c5d-6d85aaaed606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:13.591807 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7adf-158b-45ed-8c5d-6d85aaaed606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:13.592128 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7adf-158b-45ed-8c5d-6d85aaaed606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:13.592406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7adf-158b-45ed-8c5d-6d85aaaed606 admin admin] PATH_INFO: `/v3/projects/39624433ed7c49eab263c77b84852935/users/43a27b705cfb435ab8d3179dc9eb5c29/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:13.594376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c7adf-158b-45ed-8c5d-6d85aaaed606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39624433ed7c49eab263c77b84852935, user_id=43a27b705cfb435ab8d3179dc9eb5c29, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:13.597177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c7adf-158b-45ed-8c5d-6d85aaaed606 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:13.617480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 954/1899] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:13 2022] PUT /identity/v3/projects/39624433ed7c49eab263c77b84852935/users/43a27b705cfb435ab8d3179dc9eb5c29/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:13.619616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e01d1-7456-4f2c-a98c-7ff0dfa07d27 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:13.620307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e01d1-7456-4f2c-a98c-7ff0dfa07d27 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:13.620718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e01d1-7456-4f2c-a98c-7ff0dfa07d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:13.656362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-3f2e01d1-7456-4f2c-a98c-7ff0dfa07d27 None None] MFA Rules not processed for user `43a27b705cfb435ab8d3179dc9eb5c29`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:13.657605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3f2e01d1-7456-4f2c-a98c-7ff0dfa07d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:13.730227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 946/1900] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:13.741528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c7adf-158b-45ed-8c5d-6d85aaaed606 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:13.757866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7f3c7adf-158b-45ed-8c5d-6d85aaaed606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:13.798982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c7adf-158b-45ed-8c5d-6d85aaaed606 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:13.803827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b4ec-5144-439a-8d21-0bdce6241919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:13.804520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b4ec-5144-439a-8d21-0bdce6241919 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:13.804808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b4ec-5144-439a-8d21-0bdce6241919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:13.805090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b4ec-5144-439a-8d21-0bdce6241919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:13.814344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b4ec-5144-439a-8d21-0bdce6241919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:13.815796 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b4ec-5144-439a-8d21-0bdce6241919 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:13.826169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 955/1901] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:13.857293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e01d1-7456-4f2c-a98c-7ff0dfa07d27 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:13.917834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e01d1-7456-4f2c-a98c-7ff0dfa07d27 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:13.922459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:13.923345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:13.923632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:13.923935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] PATH_INFO: `/v3/users/82a20b6e108d491fbce44bcd2df3480e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:13.925137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a20b6e108d491fbce44bcd2df3480e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:13.927616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:14.280110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a20b6e108d491fbce44bcd2df3480e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:14.415427 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a20b6e108d491fbce44bcd2df3480e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:14.428602 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a20b6e108d491fbce44bcd2df3480e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:14.429246 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a20b6e108d491fbce44bcd2df3480e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:14.436368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a20b6e108d491fbce44bcd2df3480e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:14.442424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 947/1902] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:13 2022] DELETE /identity/v3/users/82a20b6e108d491fbce44bcd2df3480e => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:14.446859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3ecd-553b-4cc0-afed-f07a6dab77af None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:14.447168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3ecd-553b-4cc0-afed-f07a6dab77af None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:14.447434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3ecd-553b-4cc0-afed-f07a6dab77af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:14.461466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:14.465386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4fbd3ecd-553b-4cc0-afed-f07a6dab77af None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:14.466565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4fbd3ecd-553b-4cc0-afed-f07a6dab77af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:14.526048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 956/1903] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:14.536039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:14.543278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:14.563961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:14.594718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f448788-0093-447f-a798-ba3ecd5dee06 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:14.598503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a513a-f976-44f7-9802-7d5e0be95e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:14.603627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a513a-f976-44f7-9802-7d5e0be95e0d service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:14.603627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a513a-f976-44f7-9802-7d5e0be95e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:14.603627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a513a-f976-44f7-9802-7d5e0be95e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:14.609285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a513a-f976-44f7-9802-7d5e0be95e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:14.610735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a513a-f976-44f7-9802-7d5e0be95e0d service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:14.620671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 948/1904] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:14.935411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:15.102983 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3ecd-553b-4cc0-afed-f07a6dab77af None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:15.105524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4fbd3ecd-553b-4cc0-afed-f07a6dab77af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:15.119314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:15.126855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3ecd-553b-4cc0-afed-f07a6dab77af None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:15.131445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:15.132381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:15.132738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:15.132984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] PATH_INFO: `/v3/projects/55de4ac52a3e4232928ffe054bee8beb` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:15.134183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=55de4ac52a3e4232928ffe054bee8beb)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:15.140655 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:15.234353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55de4ac52a3e4232928ffe054bee8beb', 'request_id': 'req-0638b94c-bb44-4b17-8323-1ca66cfa60bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:15.241721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55de4ac52a3e4232928ffe054bee8beb', 'request_id': 'req-0638b94c-bb44-4b17-8323-1ca66cfa60bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:15.309951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55de4ac52a3e4232928ffe054bee8beb', 'request_id': 'req-0638b94c-bb44-4b17-8323-1ca66cfa60bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:15.321792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] The token cache is being invalidate because project 55de4ac52a3e4232928ffe054bee8beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:15.322484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:15.322484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:15.324558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 957/1905] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:15 2022] DELETE /identity/v3/projects/55de4ac52a3e4232928ffe054bee8beb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:15.329843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a513a-f976-44f7-9802-7d5e0be95e0d service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:15.358759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a513a-f976-44f7-9802-7d5e0be95e0d service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:15.406811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:15.581553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:15.581553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:15.581553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] PATH_INFO: `/v3/users/43a27b705cfb435ab8d3179dc9eb5c29` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:15.581553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a27b705cfb435ab8d3179dc9eb5c29)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:15.581553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:15.678474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:15.886537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a27b705cfb435ab8d3179dc9eb5c29'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:15.974998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a27b705cfb435ab8d3179dc9eb5c29'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:15.987449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a27b705cfb435ab8d3179dc9eb5c29'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:15.988123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a27b705cfb435ab8d3179dc9eb5c29'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:15.995227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8f0c4dd9-7507-4e34-ac94-8a93f0a91fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a27b705cfb435ab8d3179dc9eb5c29'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:16.001186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 949/1906] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:15 2022] DELETE /identity/v3/users/43a27b705cfb435ab8d3179dc9eb5c29 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:16.175499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:16.256138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:16.388305 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:16.389785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:16.403925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638b94c-bb44-4b17-8323-1ca66cfa60bf admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:16.463395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:16.464275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:16.465180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:16.465463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:16.465742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] PATH_INFO: `/v3/projects/39624433ed7c49eab263c77b84852935` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:16.466925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39624433ed7c49eab263c77b84852935)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:16.468905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:16.574245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39624433ed7c49eab263c77b84852935', 'request_id': 'req-02331582-9120-4cc8-b4a3-e39b5d7a4e87'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:16.575274 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:16.580440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39624433ed7c49eab263c77b84852935', 'request_id': 'req-02331582-9120-4cc8-b4a3-e39b5d7a4e87'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:16.661291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39624433ed7c49eab263c77b84852935', 'request_id': 'req-02331582-9120-4cc8-b4a3-e39b5d7a4e87'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:16.673454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] The token cache is being invalidate because project 39624433ed7c49eab263c77b84852935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:16.673733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:16.674430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02331582-9120-4cc8-b4a3-e39b5d7a4e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:16.676780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 958/1907] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:16 2022] DELETE /identity/v3/projects/39624433ed7c49eab263c77b84852935 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:16.681589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7485ed-bb59-4b59-85db-3c1e3762efa7 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:16.682375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7485ed-bb59-4b59-85db-3c1e3762efa7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:16.682375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7485ed-bb59-4b59-85db-3c1e3762efa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:16.700718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-cf7485ed-bb59-4b59-85db-3c1e3762efa7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:16.702259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cf7485ed-bb59-4b59-85db-3c1e3762efa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:16.762826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 950/1908] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:16.773938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2e636-79f5-46bb-a876-2b8d6a4bdc48 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:16.773938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2e636-79f5-46bb-a876-2b8d6a4bdc48 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:16.773938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2e636-79f5-46bb-a876-2b8d6a4bdc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:16.789375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a4d2e636-79f5-46bb-a876-2b8d6a4bdc48 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:16.790628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a4d2e636-79f5-46bb-a876-2b8d6a4bdc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:16.805341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 959/1909] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:16.806794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7485ed-bb59-4b59-85db-3c1e3762efa7 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:16.818835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7485ed-bb59-4b59-85db-3c1e3762efa7 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:16.827925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c61d72-4dc2-42fb-9e8a-a71afefbf9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:16.827925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c61d72-4dc2-42fb-9e8a-a71afefbf9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:16.827925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c61d72-4dc2-42fb-9e8a-a71afefbf9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:16.827925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c61d72-4dc2-42fb-9e8a-a71afefbf9f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:16.836049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c61d72-4dc2-42fb-9e8a-a71afefbf9f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:21:16.836049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c61d72-4dc2-42fb-9e8a-a71afefbf9f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:16.836049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c61d72-4dc2-42fb-9e8a-a71afefbf9f4 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:16.846422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 951/1910] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:21:16.847703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2e636-79f5-46bb-a876-2b8d6a4bdc48 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:16.858535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2e636-79f5-46bb-a876-2b8d6a4bdc48 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:16.862055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:16.863724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4645f-7059-42d5-9938-66260f8d3193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:16.864521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4645f-7059-42d5-9938-66260f8d3193 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:16.871080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4645f-7059-42d5-9938-66260f8d3193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:16.871080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4645f-7059-42d5-9938-66260f8d3193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:16.871080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4645f-7059-42d5-9938-66260f8d3193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:16.871080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4645f-7059-42d5-9938-66260f8d3193 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:16.982189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 960/1911] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:16 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:16.986378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c61d72-4dc2-42fb-9e8a-a71afefbf9f4 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:16.997251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c61d72-4dc2-42fb-9e8a-a71afefbf9f4 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:17.054423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f875d-52ec-4e29-90ad-54658c81c4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:17.055058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:17.055171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f875d-52ec-4e29-90ad-54658c81c4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:17.055380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f875d-52ec-4e29-90ad-54658c81c4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:17.055659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f875d-52ec-4e29-90ad-54658c81c4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:17.056414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f875d-52ec-4e29-90ad-54658c81c4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:17.058313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f875d-52ec-4e29-90ad-54658c81c4b4 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:17.148970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 952/1912] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:16 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:17.154084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4645f-7059-42d5-9938-66260f8d3193 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:17.165148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4645f-7059-42d5-9938-66260f8d3193 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:17.170287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be9e6f-85e4-411d-a3f0-d993ce46fcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:17.170952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be9e6f-85e4-411d-a3f0-d993ce46fcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:17.171236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be9e6f-85e4-411d-a3f0-d993ce46fcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:17.171514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be9e6f-85e4-411d-a3f0-d993ce46fcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:17.172314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be9e6f-85e4-411d-a3f0-d993ce46fcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:17.173903 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be9e6f-85e4-411d-a3f0-d993ce46fcb1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:17.183894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 961/1913] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:17.194391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f875d-52ec-4e29-90ad-54658c81c4b4 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:17.204325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f875d-52ec-4e29-90ad-54658c81c4b4 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:17.209866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8ab1a-e647-44cf-b577-daa8d13ebf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:17.210567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8ab1a-e647-44cf-b577-daa8d13ebf7e admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:17.210855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8ab1a-e647-44cf-b577-daa8d13ebf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:17.211163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8ab1a-e647-44cf-b577-daa8d13ebf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:17.211923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8ab1a-e647-44cf-b577-daa8d13ebf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:17.213773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8ab1a-e647-44cf-b577-daa8d13ebf7e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:17.223971 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 953/1914] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:17.228000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be9e6f-85e4-411d-a3f0-d993ce46fcb1 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:17.237750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be9e6f-85e4-411d-a3f0-d993ce46fcb1 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:17.242302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad5e2b-4842-45f2-9d4a-76361997a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:17.247452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad5e2b-4842-45f2-9d4a-76361997a9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:17.247452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad5e2b-4842-45f2-9d4a-76361997a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:17.247452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad5e2b-4842-45f2-9d4a-76361997a9fe admin admin] PATH_INFO: `/v3/projects/594b418291d3473684ae709053e5e011/users/6c7ec9fe7c2c44e983e0bcd8efe824a3/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:17.258584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad5e2b-4842-45f2-9d4a-76361997a9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=594b418291d3473684ae709053e5e011, user_id=6c7ec9fe7c2c44e983e0bcd8efe824a3, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:17.261299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad5e2b-4842-45f2-9d4a-76361997a9fe admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:17.375032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 962/1915] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:17 2022] PUT /identity/v3/projects/594b418291d3473684ae709053e5e011/users/6c7ec9fe7c2c44e983e0bcd8efe824a3/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:17.386037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20342028-a5c4-4862-b2ee-fd0082d670a9 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:17.386352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20342028-a5c4-4862-b2ee-fd0082d670a9 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:17.386638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20342028-a5c4-4862-b2ee-fd0082d670a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:17.413255 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-20342028-a5c4-4862-b2ee-fd0082d670a9 None None] MFA Rules not processed for user `6c7ec9fe7c2c44e983e0bcd8efe824a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:17.414755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-20342028-a5c4-4862-b2ee-fd0082d670a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:17.428052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:17.455342 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:17.479445 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 954/1916] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:17.484010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad5e2b-4842-45f2-9d4a-76361997a9fe admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:17.544404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad5e2b-4842-45f2-9d4a-76361997a9fe admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:17.546760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:17.549286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3a9e2-bff5-4e79-a16e-5986c5671a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:17.549950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3a9e2-bff5-4e79-a16e-5986c5671a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:17.550232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3a9e2-bff5-4e79-a16e-5986c5671a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:17.550530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3a9e2-bff5-4e79-a16e-5986c5671a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:17.551706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3a9e2-bff5-4e79-a16e-5986c5671a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:17.553679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3a9e2-bff5-4e79-a16e-5986c5671a86 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:17.565199 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:17.622131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 963/1917] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:17 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:17.626157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20342028-a5c4-4862-b2ee-fd0082d670a9 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:17.637203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20342028-a5c4-4862-b2ee-fd0082d670a9 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:17.692880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4738a7f-5292-4039-9b90-c4dda5d42af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:17.693555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4738a7f-5292-4039-9b90-c4dda5d42af5 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:17.693843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4738a7f-5292-4039-9b90-c4dda5d42af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:17.694125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4738a7f-5292-4039-9b90-c4dda5d42af5 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:17.694818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4738a7f-5292-4039-9b90-c4dda5d42af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:17.695293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:17.696791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4738a7f-5292-4039-9b90-c4dda5d42af5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:17.763505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:17.811949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 955/1918] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:17 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:17.813609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3a9e2-bff5-4e79-a16e-5986c5671a86 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:17.824594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3a9e2-bff5-4e79-a16e-5986c5671a86 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:17.829272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e55f8-7f45-4a9e-a16a-ec382296c9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:17.829949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e55f8-7f45-4a9e-a16a-ec382296c9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:17.830618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e55f8-7f45-4a9e-a16a-ec382296c9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:17.830618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e55f8-7f45-4a9e-a16a-ec382296c9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:17.831228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e55f8-7f45-4a9e-a16a-ec382296c9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:17.833444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e55f8-7f45-4a9e-a16a-ec382296c9bc admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:17.847637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 964/1919] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:17.851368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4738a7f-5292-4039-9b90-c4dda5d42af5 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:17.868015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4738a7f-5292-4039-9b90-c4dda5d42af5 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:17.873933 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b5027-3851-4534-928f-3e7e5ef0a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:17.874912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b5027-3851-4534-928f-3e7e5ef0a1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:17.875269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b5027-3851-4534-928f-3e7e5ef0a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:17.875616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b5027-3851-4534-928f-3e7e5ef0a1a9 admin admin] PATH_INFO: `/v3/projects/b51aa583b4ea4f939164cd7fcf03dda2/users/9f27148040a24db1a05bbcb1c1fe6e4a/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:17.891813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b5027-3851-4534-928f-3e7e5ef0a1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51aa583b4ea4f939164cd7fcf03dda2, user_id=9f27148040a24db1a05bbcb1c1fe6e4a, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:17.895169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b5027-3851-4534-928f-3e7e5ef0a1a9 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:17.952603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 956/1920] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:17 2022] PUT /identity/v3/projects/b51aa583b4ea4f939164cd7fcf03dda2/users/9f27148040a24db1a05bbcb1c1fe6e4a/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:17.956321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e55f8-7f45-4a9e-a16a-ec382296c9bc admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:17.966864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e55f8-7f45-4a9e-a16a-ec382296c9bc admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:17.992245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:18.027541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57985-7c1f-4df5-911f-bc4751e6dd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:18.028181 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57985-7c1f-4df5-911f-bc4751e6dd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:18.028468 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57985-7c1f-4df5-911f-bc4751e6dd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:18.028743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57985-7c1f-4df5-911f-bc4751e6dd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:18.029482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57985-7c1f-4df5-911f-bc4751e6dd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:18.031138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57985-7c1f-4df5-911f-bc4751e6dd6e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:18.041946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 965/1921] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:18.045955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b5027-3851-4534-928f-3e7e5ef0a1a9 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:18.057270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b5027-3851-4534-928f-3e7e5ef0a1a9 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:18.062160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc603f-7622-4dfd-9c6c-8f37b50ab2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:18.063276 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc603f-7622-4dfd-9c6c-8f37b50ab2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:18.063565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc603f-7622-4dfd-9c6c-8f37b50ab2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:18.063844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc603f-7622-4dfd-9c6c-8f37b50ab2cc admin admin] PATH_INFO: `/v3/projects/b51aa583b4ea4f939164cd7fcf03dda2/users/9f27148040a24db1a05bbcb1c1fe6e4a/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:18.065983 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc603f-7622-4dfd-9c6c-8f37b50ab2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51aa583b4ea4f939164cd7fcf03dda2, user_id=9f27148040a24db1a05bbcb1c1fe6e4a, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:18.068756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc603f-7622-4dfd-9c6c-8f37b50ab2cc admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:18.079371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 957/1922] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:18 2022] PUT /identity/v3/projects/b51aa583b4ea4f939164cd7fcf03dda2/users/9f27148040a24db1a05bbcb1c1fe6e4a/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:18.093046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c830-7db3-4afc-a398-99b75b424db3 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:18.093046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c830-7db3-4afc-a398-99b75b424db3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:18.093046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c830-7db3-4afc-a398-99b75b424db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:18.119108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a149c830-7db3-4afc-a398-99b75b424db3 None None] MFA Rules not processed for user `9f27148040a24db1a05bbcb1c1fe6e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:18.120406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a149c830-7db3-4afc-a398-99b75b424db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:18.129778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:18.187234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:18.191231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 966/1923] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:18.202046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc603f-7622-4dfd-9c6c-8f37b50ab2cc admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:18.203935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-55bc603f-7622-4dfd-9c6c-8f37b50ab2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:18.264054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc603f-7622-4dfd-9c6c-8f37b50ab2cc admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:18.267996 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43146539-e3a8-457a-b223-66b709b829b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:18.268664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43146539-e3a8-457a-b223-66b709b829b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:18.268955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43146539-e3a8-457a-b223-66b709b829b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:18.269236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43146539-e3a8-457a-b223-66b709b829b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:18.278613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43146539-e3a8-457a-b223-66b709b829b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:18.280035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43146539-e3a8-457a-b223-66b709b829b1 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:18.290035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 958/1924] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:18.421959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149c830-7db3-4afc-a398-99b75b424db3 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:18.481760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149c830-7db3-4afc-a398-99b75b424db3 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:18.486213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:18.487087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:18.487369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:18.487644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] PATH_INFO: `/v3/users/6c7ec9fe7c2c44e983e0bcd8efe824a3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:18.488891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7ec9fe7c2c44e983e0bcd8efe824a3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:18.490810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:18.609267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:18.672627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:18.684874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7ec9fe7c2c44e983e0bcd8efe824a3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:18.769134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7ec9fe7c2c44e983e0bcd8efe824a3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:18.781881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7ec9fe7c2c44e983e0bcd8efe824a3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:18.782524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7ec9fe7c2c44e983e0bcd8efe824a3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:18.789351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7ec9fe7c2c44e983e0bcd8efe824a3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:18.796836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 967/1925] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:18 2022] DELETE /identity/v3/users/6c7ec9fe7c2c44e983e0bcd8efe824a3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:18.800515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1c2f6-79b9-4bca-a98d-16843c6631f9 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:18.800817 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1c2f6-79b9-4bca-a98d-16843c6631f9 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:18.801278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1c2f6-79b9-4bca-a98d-16843c6631f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:18.818848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-dea1c2f6-79b9-4bca-a98d-16843c6631f9 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:18.820086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-dea1c2f6-79b9-4bca-a98d-16843c6631f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:18.880111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 959/1926] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:21:18.889918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:18.891611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:18.985042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e813a9-698b-4d0e-bf74-3b47944efb4d admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:18.989064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8278f9-23c4-4083-b7aa-1a3f4d07e0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:18.989911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8278f9-23c4-4083-b7aa-1a3f4d07e0ee service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:18.990267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8278f9-23c4-4083-b7aa-1a3f4d07e0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:18.990732 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8278f9-23c4-4083-b7aa-1a3f4d07e0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:19.001365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8278f9-23c4-4083-b7aa-1a3f4d07e0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:19.003259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8278f9-23c4-4083-b7aa-1a3f4d07e0ee service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:19.044163 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 968/1927] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:19.090182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:19.175719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:19.639119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1c2f6-79b9-4bca-a98d-16843c6631f9 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:19.641178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-dea1c2f6-79b9-4bca-a98d-16843c6631f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:19.653204 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1c2f6-79b9-4bca-a98d-16843c6631f9 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:19.657876 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:19.658846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:19.659158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:19.659445 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] PATH_INFO: `/v3/projects/594b418291d3473684ae709053e5e011` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:19.661184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594b418291d3473684ae709053e5e011)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:19.663092 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:19.682876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8278f9-23c4-4083-b7aa-1a3f4d07e0ee service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:19.684411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5d8278f9-23c4-4083-b7aa-1a3f4d07e0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:19.740722 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8278f9-23c4-4083-b7aa-1a3f4d07e0ee service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:19.744558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7f810-b303-4bed-b46d-2a58d71fa316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:19.745215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7f810-b303-4bed-b46d-2a58d71fa316 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:19.745496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7f810-b303-4bed-b46d-2a58d71fa316 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:19.745767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7f810-b303-4bed-b46d-2a58d71fa316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:19.747569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d1f7f810-b303-4bed-b46d-2a58d71fa316 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:19.804313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7f810-b303-4bed-b46d-2a58d71fa316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:19.805762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7f810-b303-4bed-b46d-2a58d71fa316 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:19.814878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 969/1928] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:21:19.838377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594b418291d3473684ae709053e5e011', 'request_id': 'req-4188bc7d-24ed-4474-b422-27e089912056'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:19.844963 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594b418291d3473684ae709053e5e011', 'request_id': 'req-4188bc7d-24ed-4474-b422-27e089912056'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:19.855384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:19.917434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594b418291d3473684ae709053e5e011', 'request_id': 'req-4188bc7d-24ed-4474-b422-27e089912056'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:19.929987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] The token cache is being invalidate because project 594b418291d3473684ae709053e5e011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:19.930279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:19.930939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:19.932516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 960/1929] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:19 2022] DELETE /identity/v3/projects/594b418291d3473684ae709053e5e011 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:19.936481 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7f810-b303-4bed-b46d-2a58d71fa316 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:19.947449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7f810-b303-4bed-b46d-2a58d71fa316 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:19.988891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:20.004521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:20.005405 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:20.005688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:20.005965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] PATH_INFO: `/v3/users/9f27148040a24db1a05bbcb1c1fe6e4a` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:20.007164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f27148040a24db1a05bbcb1c1fe6e4a)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:20.009207 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:20.246813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f27148040a24db1a05bbcb1c1fe6e4a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:20.300563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f27148040a24db1a05bbcb1c1fe6e4a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:20.314182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f27148040a24db1a05bbcb1c1fe6e4a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:20.315078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f27148040a24db1a05bbcb1c1fe6e4a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:20.322827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-29f2a81e-ed6c-4773-b3e7-0c592542b794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f27148040a24db1a05bbcb1c1fe6e4a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:20.329947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 970/1930] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:19 2022] DELETE /identity/v3/users/9f27148040a24db1a05bbcb1c1fe6e4a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:21:20.472164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:20.959651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:20.961244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:20.975383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188bc7d-24ed-4474-b422-27e089912056 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:21.031527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:21.031932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:21.032442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:21.032723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:21.032999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] PATH_INFO: `/v3/projects/b51aa583b4ea4f939164cd7fcf03dda2` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:21.034178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51aa583b4ea4f939164cd7fcf03dda2)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:21.036151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:21.158700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51aa583b4ea4f939164cd7fcf03dda2', 'request_id': 'req-ded19709-f354-4def-a22a-b791c1731cac'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:21.165046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51aa583b4ea4f939164cd7fcf03dda2', 'request_id': 'req-ded19709-f354-4def-a22a-b791c1731cac'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:21.266415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51aa583b4ea4f939164cd7fcf03dda2', 'request_id': 'req-ded19709-f354-4def-a22a-b791c1731cac'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:21.269054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:21.278716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] The token cache is being invalidate because project b51aa583b4ea4f939164cd7fcf03dda2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:21.279009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:21.279637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ded19709-f354-4def-a22a-b791c1731cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:21.281517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 961/1931] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:20 2022] DELETE /identity/v3/projects/b51aa583b4ea4f939164cd7fcf03dda2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:21.286217 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66323129-2640-44f2-a813-10a901e56be8 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:21.286506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66323129-2640-44f2-a813-10a901e56be8 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:21.286790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66323129-2640-44f2-a813-10a901e56be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:21.305061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-66323129-2640-44f2-a813-10a901e56be8 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:21.306263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-66323129-2640-44f2-a813-10a901e56be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:21.367087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 971/1932] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:21.375115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021c468-f921-4751-a042-8fe324ec8680 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:21.375412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021c468-f921-4751-a042-8fe324ec8680 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:21.375702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021c468-f921-4751-a042-8fe324ec8680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:21.396691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c021c468-f921-4751-a042-8fe324ec8680 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:21.398535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c021c468-f921-4751-a042-8fe324ec8680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:21.406702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 962/1933] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:21.411017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66323129-2640-44f2-a813-10a901e56be8 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:21.422027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66323129-2640-44f2-a813-10a901e56be8 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:21.427465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1bb14-2700-4579-bd2b-30f8664e9888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:21.428189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1bb14-2700-4579-bd2b-30f8664e9888 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:21.428478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1bb14-2700-4579-bd2b-30f8664e9888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:21.428748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1bb14-2700-4579-bd2b-30f8664e9888 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:21.429506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1bb14-2700-4579-bd2b-30f8664e9888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:21:21.429831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1bb14-2700-4579-bd2b-30f8664e9888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:21.431521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1bb14-2700-4579-bd2b-30f8664e9888 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:21.449166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 972/1934] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:21:21.453422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021c468-f921-4751-a042-8fe324ec8680 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:21.463146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021c468-f921-4751-a042-8fe324ec8680 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:21.467917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eb2b7-1ad5-4126-96f7-17554b69ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:21.468652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eb2b7-1ad5-4126-96f7-17554b69ddd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:21.471894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eb2b7-1ad5-4126-96f7-17554b69ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:21.471894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eb2b7-1ad5-4126-96f7-17554b69ddd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:21.471894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016eb2b7-1ad5-4126-96f7-17554b69ddd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:21.471894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016eb2b7-1ad5-4126-96f7-17554b69ddd6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:21.591153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 963/1935] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:21 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:21.595956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1bb14-2700-4579-bd2b-30f8664e9888 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:21.606591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1bb14-2700-4579-bd2b-30f8664e9888 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:21.668014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:21.682395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebeb17-0da0-404d-9bec-5b52cd3016f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:21.683148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebeb17-0da0-404d-9bec-5b52cd3016f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:21.683501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebeb17-0da0-404d-9bec-5b52cd3016f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:21.683845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebeb17-0da0-404d-9bec-5b52cd3016f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:21.684673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebeb17-0da0-404d-9bec-5b52cd3016f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:21.686966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebeb17-0da0-404d-9bec-5b52cd3016f3 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:21.770467 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 973/1936] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:21 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:21.774928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eb2b7-1ad5-4126-96f7-17554b69ddd6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:21.786548 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eb2b7-1ad5-4126-96f7-17554b69ddd6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:21.791774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750fd1d-a6b6-48e9-b35d-cc72732433ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:21.792497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750fd1d-a6b6-48e9-b35d-cc72732433ec admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:21.792784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750fd1d-a6b6-48e9-b35d-cc72732433ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:21.793088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750fd1d-a6b6-48e9-b35d-cc72732433ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:21.793948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750fd1d-a6b6-48e9-b35d-cc72732433ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:21.795635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750fd1d-a6b6-48e9-b35d-cc72732433ec admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:21.809615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 964/1937] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:21.811024 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebeb17-0da0-404d-9bec-5b52cd3016f3 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:21.822266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebeb17-0da0-404d-9bec-5b52cd3016f3 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:21.827403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd4352-09c8-48fe-bd81-6fc1fbc90ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:21.831501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd4352-09c8-48fe-bd81-6fc1fbc90ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:21.831501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd4352-09c8-48fe-bd81-6fc1fbc90ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:21.831501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd4352-09c8-48fe-bd81-6fc1fbc90ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:21.831501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd4352-09c8-48fe-bd81-6fc1fbc90ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:21.831828 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd4352-09c8-48fe-bd81-6fc1fbc90ffb admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:21.844740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 974/1938] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:21.849984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750fd1d-a6b6-48e9-b35d-cc72732433ec admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:21.872266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750fd1d-a6b6-48e9-b35d-cc72732433ec admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:21.877413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9a02a-7f78-4543-9be7-e15739c11701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:21.878337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9a02a-7f78-4543-9be7-e15739c11701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:21.878624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9a02a-7f78-4543-9be7-e15739c11701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:21.879482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9a02a-7f78-4543-9be7-e15739c11701 admin admin] PATH_INFO: `/v3/projects/2f7c196500524b6aa97455e56962baec/users/eb4e3e014c0a43429edd73ec715b1c47/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:21.896972 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9a02a-7f78-4543-9be7-e15739c11701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7c196500524b6aa97455e56962baec, user_id=eb4e3e014c0a43429edd73ec715b1c47, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:21.899761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9a02a-7f78-4543-9be7-e15739c11701 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:22.000217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 965/1939] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:21 2022] PUT /identity/v3/projects/2f7c196500524b6aa97455e56962baec/users/eb4e3e014c0a43429edd73ec715b1c47/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:22.011238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01262-6bab-4a04-80bc-0098085b2120 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:22.011527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01262-6bab-4a04-80bc-0098085b2120 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:22.011813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01262-6bab-4a04-80bc-0098085b2120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:22.038205 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-1eb01262-6bab-4a04-80bc-0098085b2120 None None] MFA Rules not processed for user `eb4e3e014c0a43429edd73ec715b1c47`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:22.039339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1eb01262-6bab-4a04-80bc-0098085b2120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:22.103325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 975/1940] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:22.115333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9a02a-7f78-4543-9be7-e15739c11701 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:22.117078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-47b9a02a-7f78-4543-9be7-e15739c11701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:22.174146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9a02a-7f78-4543-9be7-e15739c11701 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:22.178416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d53f4-04f9-4abf-9e60-c90a6c197409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:22.179136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d53f4-04f9-4abf-9e60-c90a6c197409 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:22.179415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d53f4-04f9-4abf-9e60-c90a6c197409 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:22.179688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d53f4-04f9-4abf-9e60-c90a6c197409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:22.188151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d53f4-04f9-4abf-9e60-c90a6c197409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:22.189591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d53f4-04f9-4abf-9e60-c90a6c197409 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:22.199149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 966/1941] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:24.947918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb01262-6bab-4a04-80bc-0098085b2120 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:24.958946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb01262-6bab-4a04-80bc-0098085b2120 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:24.964160 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec04b8-87bd-4cb0-a4ec-39e98b99c977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:24.964823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec04b8-87bd-4cb0-a4ec-39e98b99c977 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:24.965112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec04b8-87bd-4cb0-a4ec-39e98b99c977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:24.965391 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec04b8-87bd-4cb0-a4ec-39e98b99c977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:24.967266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d9ec04b8-87bd-4cb0-a4ec-39e98b99c977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:25.055339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec04b8-87bd-4cb0-a4ec-39e98b99c977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:25.056857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec04b8-87bd-4cb0-a4ec-39e98b99c977 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:25.067322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 976/1942] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:27.968953 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d53f4-04f9-4abf-9e60-c90a6c197409 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:27.970483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-329d53f4-04f9-4abf-9e60-c90a6c197409 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:28.051424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d53f4-04f9-4abf-9e60-c90a6c197409 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:28.056379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:28.059309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:28.059309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:28.059309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] PATH_INFO: `/v3/users/7f5cee042c324929879eed0c4988393a` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:28.060240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f5cee042c324929879eed0c4988393a)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:28.062227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:28.245447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:28.258289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f5cee042c324929879eed0c4988393a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:28.351726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f5cee042c324929879eed0c4988393a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:28.364306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f5cee042c324929879eed0c4988393a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:28.365014 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f5cee042c324929879eed0c4988393a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:28.371726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f5cee042c324929879eed0c4988393a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:28.377660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 967/1943] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:27 2022] DELETE /identity/v3/users/7f5cee042c324929879eed0c4988393a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:28.382286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2e3eb-7978-46a8-bed6-14871b895c38 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:28.382774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2e3eb-7978-46a8-bed6-14871b895c38 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:28.382872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2e3eb-7978-46a8-bed6-14871b895c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:28.405669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-65f2e3eb-7978-46a8-bed6-14871b895c38 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:28.406969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-65f2e3eb-7978-46a8-bed6-14871b895c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:28.461088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:28.474773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 977/1944] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:28.484505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:28.486006 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:28.545306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e593f1-f94c-453c-890d-b9d42cd2dd34 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:28.553459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bd7ea-04d6-4acb-bcf4-57e351bc954f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:28.553459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bd7ea-04d6-4acb-bcf4-57e351bc954f service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:28.553459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bd7ea-04d6-4acb-bcf4-57e351bc954f service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:28.553459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bd7ea-04d6-4acb-bcf4-57e351bc954f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:28.559425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bd7ea-04d6-4acb-bcf4-57e351bc954f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:28.560942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bd7ea-04d6-4acb-bcf4-57e351bc954f service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:28.570645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 968/1945] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:29.150916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2e3eb-7978-46a8-bed6-14871b895c38 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:29.152631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-65f2e3eb-7978-46a8-bed6-14871b895c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:29.167893 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2e3eb-7978-46a8-bed6-14871b895c38 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:29.172877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:29.177377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:29.177377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:29.177377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] PATH_INFO: `/v3/projects/a429311dec834f85b201d08c927d71e2` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:29.177377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a429311dec834f85b201d08c927d71e2)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:29.178675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:29.304629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a429311dec834f85b201d08c927d71e2', 'request_id': 'req-a9b1e427-628a-4ce5-83ac-0f60f29b2916'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:29.311959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a429311dec834f85b201d08c927d71e2', 'request_id': 'req-a9b1e427-628a-4ce5-83ac-0f60f29b2916'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:29.443688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a429311dec834f85b201d08c927d71e2', 'request_id': 'req-a9b1e427-628a-4ce5-83ac-0f60f29b2916'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:29.458049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] The token cache is being invalidate because project a429311dec834f85b201d08c927d71e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:29.458335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:29.459026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:29.460660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 978/1946] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:29 2022] DELETE /identity/v3/projects/a429311dec834f85b201d08c927d71e2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:29.464929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bd7ea-04d6-4acb-bcf4-57e351bc954f service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:29.476087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bd7ea-04d6-4acb-bcf4-57e351bc954f service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:29.534256 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:29.535166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:29.535433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:29.535710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] PATH_INFO: `/v3/users/6e65c3bab7f84e78a6eff2e5e7a0c6a8` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:29.536936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e65c3bab7f84e78a6eff2e5e7a0c6a8)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:29.538868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:29.730653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e65c3bab7f84e78a6eff2e5e7a0c6a8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:29.820081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e65c3bab7f84e78a6eff2e5e7a0c6a8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:29.821339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:29.832498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e65c3bab7f84e78a6eff2e5e7a0c6a8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:29.835994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e65c3bab7f84e78a6eff2e5e7a0c6a8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:29.840103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e65c3bab7f84e78a6eff2e5e7a0c6a8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:29.845929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 969/1947] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:29 2022] DELETE /identity/v3/users/6e65c3bab7f84e78a6eff2e5e7a0c6a8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:30.318579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:30.320081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:30.342532 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1e427-628a-4ce5-83ac-0f60f29b2916 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:30.415706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:30.416855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:30.417136 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:30.417408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] PATH_INFO: `/v3/projects/e00cf498a36245819e014f764822bee5` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:30.419287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00cf498a36245819e014f764822bee5)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:30.421234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:30.561610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00cf498a36245819e014f764822bee5', 'request_id': 'req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:30.567999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00cf498a36245819e014f764822bee5', 'request_id': 'req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:30.637612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00cf498a36245819e014f764822bee5', 'request_id': 'req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:30.650825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] The token cache is being invalidate because project e00cf498a36245819e014f764822bee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:30.651165 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:30.652068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:30.654286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 979/1948] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:30 2022] DELETE /identity/v3/projects/e00cf498a36245819e014f764822bee5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:30.658784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:30.660883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:30.674549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab9e6b-f6d1-4515-b357-c98cefc90861 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:30.744746 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:30.745651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:30.746094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:30.746389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] PATH_INFO: `/v3/users/7881b9da3b9744e69dd5cae9ab95a50f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:30.747972 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7881b9da3b9744e69dd5cae9ab95a50f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:30.749916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:30.989808 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7881b9da3b9744e69dd5cae9ab95a50f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:31.145991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7881b9da3b9744e69dd5cae9ab95a50f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:31.158569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7881b9da3b9744e69dd5cae9ab95a50f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:31.159252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7881b9da3b9744e69dd5cae9ab95a50f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:31.166084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b6f46e97-2f0c-4514-96d0-1470e89151ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7881b9da3b9744e69dd5cae9ab95a50f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:31.172183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 970/1949] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:21:30 2022] DELETE /identity/v3/users/7881b9da3b9744e69dd5cae9ab95a50f => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:31.930950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:31.932660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:31.950342 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8adfb5-90bc-48c9-822d-6713d2aaa3de admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:31.954472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:32.023339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:32.024284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:32.024805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:32.025264 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] PATH_INFO: `/v3/projects/678127303b9046e386fc530f8c24387e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:32.026862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=678127303b9046e386fc530f8c24387e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:32.028861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:32.138845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '678127303b9046e386fc530f8c24387e', 'request_id': 'req-9419b3b8-ebea-41df-9874-e6f787ebd0f6'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:32.147277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '678127303b9046e386fc530f8c24387e', 'request_id': 'req-9419b3b8-ebea-41df-9874-e6f787ebd0f6'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:32.282637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '678127303b9046e386fc530f8c24387e', 'request_id': 'req-9419b3b8-ebea-41df-9874-e6f787ebd0f6'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:32.294273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] The token cache is being invalidate because project 678127303b9046e386fc530f8c24387e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:21:32.294563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:32.295245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9419b3b8-ebea-41df-9874-e6f787ebd0f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:21:32.296827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 980/1950] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:21:31 2022] DELETE /identity/v3/projects/678127303b9046e386fc530f8c24387e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:32.303744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb74b-5ac3-4971-a5ee-2f0a9b9dde25 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:32.304373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb74b-5ac3-4971-a5ee-2f0a9b9dde25 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:32.304470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb74b-5ac3-4971-a5ee-2f0a9b9dde25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:32.322533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9fefb74b-5ac3-4971-a5ee-2f0a9b9dde25 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:32.323759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9fefb74b-5ac3-4971-a5ee-2f0a9b9dde25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:32.384790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:32.399158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 971/1951] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:32.408282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610598d-f9bf-491e-bf1e-a6fa67be444f None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:32.408576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610598d-f9bf-491e-bf1e-a6fa67be444f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:32.408862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610598d-f9bf-491e-bf1e-a6fa67be444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:32.428803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-5610598d-f9bf-491e-bf1e-a6fa67be444f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:32.430005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5610598d-f9bf-491e-bf1e-a6fa67be444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:32.438201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 981/1952] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:32.447798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb74b-5ac3-4971-a5ee-2f0a9b9dde25 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:32.453292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb74b-5ac3-4971-a5ee-2f0a9b9dde25 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:32.457931 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6ffd0-4048-4f43-aa9d-52aafd4aecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:32.458625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6ffd0-4048-4f43-aa9d-52aafd4aecf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:32.459125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6ffd0-4048-4f43-aa9d-52aafd4aecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:32.459575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6ffd0-4048-4f43-aa9d-52aafd4aecf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:32.461355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6ffd0-4048-4f43-aa9d-52aafd4aecf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:21:32.461355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6ffd0-4048-4f43-aa9d-52aafd4aecf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:32.463125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6ffd0-4048-4f43-aa9d-52aafd4aecf9 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:32.475330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 972/1953] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:21:32.479782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610598d-f9bf-491e-bf1e-a6fa67be444f None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:32.489839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610598d-f9bf-491e-bf1e-a6fa67be444f None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:32.495470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b21243-9486-4cb9-89ed-35452389fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:32.495470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b21243-9486-4cb9-89ed-35452389fbbf admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:32.495659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b21243-9486-4cb9-89ed-35452389fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:32.495888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b21243-9486-4cb9-89ed-35452389fbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:32.496577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b21243-9486-4cb9-89ed-35452389fbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:32.499006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b21243-9486-4cb9-89ed-35452389fbbf admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:32.577384 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 982/1954] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:32 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:21:32.581062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6ffd0-4048-4f43-aa9d-52aafd4aecf9 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:32.591802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6ffd0-4048-4f43-aa9d-52aafd4aecf9 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:32.651129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef827b-5fd7-40ea-9c01-0b306e8dea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:32.651801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef827b-5fd7-40ea-9c01-0b306e8dea57 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:32.652115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef827b-5fd7-40ea-9c01-0b306e8dea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:32.652393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef827b-5fd7-40ea-9c01-0b306e8dea57 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:32.653093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef827b-5fd7-40ea-9c01-0b306e8dea57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:32.654998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef827b-5fd7-40ea-9c01-0b306e8dea57 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:32.780559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 973/1955] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:32 2022] POST /identity/v3/users => generated 305 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:32.784926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b21243-9486-4cb9-89ed-35452389fbbf admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:32.795600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b21243-9486-4cb9-89ed-35452389fbbf admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:32.800187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e425d-f63c-4abe-abd4-4a5c6bc8fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:32.800850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e425d-f63c-4abe-abd4-4a5c6bc8fcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:32.801168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e425d-f63c-4abe-abd4-4a5c6bc8fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:32.801420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e425d-f63c-4abe-abd4-4a5c6bc8fcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:32.802150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e425d-f63c-4abe-abd4-4a5c6bc8fcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:32.803771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e425d-f63c-4abe-abd4-4a5c6bc8fcb2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:32.814042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 983/1956] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:32.818072 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef827b-5fd7-40ea-9c01-0b306e8dea57 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:32.828804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef827b-5fd7-40ea-9c01-0b306e8dea57 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:32.834046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf016454-c524-47c1-907c-b9a8dea524a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:32.834710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf016454-c524-47c1-907c-b9a8dea524a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:32.835042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf016454-c524-47c1-907c-b9a8dea524a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:32.835322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf016454-c524-47c1-907c-b9a8dea524a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:32.836084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf016454-c524-47c1-907c-b9a8dea524a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:32.838140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf016454-c524-47c1-907c-b9a8dea524a2 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:32.849174 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 974/1957] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:32.853272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e425d-f63c-4abe-abd4-4a5c6bc8fcb2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:32.863749 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e425d-f63c-4abe-abd4-4a5c6bc8fcb2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:32.868834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff26a-11e1-4d34-84de-e4ce62829d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:32.869730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff26a-11e1-4d34-84de-e4ce62829d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:32.870014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff26a-11e1-4d34-84de-e4ce62829d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:32.870321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff26a-11e1-4d34-84de-e4ce62829d38 admin admin] PATH_INFO: `/v3/projects/5af38c1e6aca4348a4b325e5b9417b81/users/13a1c3ab35c94de497b45435212d3ba8/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:32.886554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bff26a-11e1-4d34-84de-e4ce62829d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af38c1e6aca4348a4b325e5b9417b81, user_id=13a1c3ab35c94de497b45435212d3ba8, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:32.889435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bff26a-11e1-4d34-84de-e4ce62829d38 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:32.973871 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 984/1958] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:32 2022] PUT /identity/v3/projects/5af38c1e6aca4348a4b325e5b9417b81/users/13a1c3ab35c94de497b45435212d3ba8/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:32.985300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e94db-d4fb-479a-970f-eb0e300593a4 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:32.985589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e94db-d4fb-479a-970f-eb0e300593a4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:32.985932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e94db-d4fb-479a-970f-eb0e300593a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:33.013666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-040e94db-d4fb-479a-970f-eb0e300593a4 None None] MFA Rules not processed for user `13a1c3ab35c94de497b45435212d3ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:33.014871 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-040e94db-d4fb-479a-970f-eb0e300593a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:33.091622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 975/1959] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:33.096045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff26a-11e1-4d34-84de-e4ce62829d38 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:33.130001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:33.156218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff26a-11e1-4d34-84de-e4ce62829d38 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:33.161374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e13e5a-6d55-47e1-86d7-aa8509eea213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:33.162038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e13e5a-6d55-47e1-86d7-aa8509eea213 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:33.162324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e13e5a-6d55-47e1-86d7-aa8509eea213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:33.162601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e13e5a-6d55-47e1-86d7-aa8509eea213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:33.163290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e13e5a-6d55-47e1-86d7-aa8509eea213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:33.165222 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e13e5a-6d55-47e1-86d7-aa8509eea213 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:33.284022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 985/1960] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:21:33 2022] POST /identity/v3/projects => generated 409 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:33.288628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e94db-d4fb-479a-970f-eb0e300593a4 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:33.299492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e94db-d4fb-479a-970f-eb0e300593a4 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:33.345080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:33.359480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fedf6-799e-4a10-9133-5b694ed84d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:33.360197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fedf6-799e-4a10-9133-5b694ed84d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:33.360484 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fedf6-799e-4a10-9133-5b694ed84d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:33.360761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fedf6-799e-4a10-9133-5b694ed84d41 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:33.361514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fedf6-799e-4a10-9133-5b694ed84d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:33.363517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fedf6-799e-4a10-9133-5b694ed84d41 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:33.512127 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 976/1961] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:21:33 2022] POST /identity/v3/users => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:21:33.515931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e13e5a-6d55-47e1-86d7-aa8509eea213 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:33.526580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e13e5a-6d55-47e1-86d7-aa8509eea213 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:33.531107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6637e-c792-46a7-9547-7ee79ab11690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:33.531764 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6637e-c792-46a7-9547-7ee79ab11690 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:33.532080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6637e-c792-46a7-9547-7ee79ab11690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:33.532358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6637e-c792-46a7-9547-7ee79ab11690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:33.533093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6637e-c792-46a7-9547-7ee79ab11690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:33.534737 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6637e-c792-46a7-9547-7ee79ab11690 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:33.545711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 986/1962] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:33.549765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fedf6-799e-4a10-9133-5b694ed84d41 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:33.559531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fedf6-799e-4a10-9133-5b694ed84d41 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:33.564117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0afcf-021f-4966-9739-114963dea717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:33.565001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0afcf-021f-4966-9739-114963dea717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:33.565284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0afcf-021f-4966-9739-114963dea717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:33.565561 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0afcf-021f-4966-9739-114963dea717 admin admin] PATH_INFO: `/v3/projects/7e7020011f3745939e0b77b4c97efff1/users/c8d0c38e36f84be6a8169c08c8ed62ae/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:33.579932 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0afcf-021f-4966-9739-114963dea717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7020011f3745939e0b77b4c97efff1, user_id=c8d0c38e36f84be6a8169c08c8ed62ae, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:33.583135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0afcf-021f-4966-9739-114963dea717 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:33.705118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 977/1963] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:33 2022] PUT /identity/v3/projects/7e7020011f3745939e0b77b4c97efff1/users/c8d0c38e36f84be6a8169c08c8ed62ae/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:33.709586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6637e-c792-46a7-9547-7ee79ab11690 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:33.719685 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6637e-c792-46a7-9547-7ee79ab11690 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:33.773313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2f9af-983d-4051-b071-4dedca6ea91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:33.773980 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2f9af-983d-4051-b071-4dedca6ea91b admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:33.774269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2f9af-983d-4051-b071-4dedca6ea91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:33.774551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2f9af-983d-4051-b071-4dedca6ea91b admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:33.775267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2f9af-983d-4051-b071-4dedca6ea91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:33.776887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2f9af-983d-4051-b071-4dedca6ea91b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:33.786486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 987/1964] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:21:33.790639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0afcf-021f-4966-9739-114963dea717 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:33.800904 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0afcf-021f-4966-9739-114963dea717 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:33.805567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dec157-c8ef-43e8-bfeb-669ca30c9ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:33.806450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec157-c8ef-43e8-bfeb-669ca30c9ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:33.806769 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec157-c8ef-43e8-bfeb-669ca30c9ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:33.807051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec157-c8ef-43e8-bfeb-669ca30c9ff3 admin admin] PATH_INFO: `/v3/projects/7e7020011f3745939e0b77b4c97efff1/users/c8d0c38e36f84be6a8169c08c8ed62ae/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:33.809043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dec157-c8ef-43e8-bfeb-669ca30c9ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7020011f3745939e0b77b4c97efff1, user_id=c8d0c38e36f84be6a8169c08c8ed62ae, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:33.811681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dec157-c8ef-43e8-bfeb-669ca30c9ff3 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:33.822458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 978/1965] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:21:33 2022] PUT /identity/v3/projects/7e7020011f3745939e0b77b4c97efff1/users/c8d0c38e36f84be6a8169c08c8ed62ae/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:21:33.833408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8998e-4049-41f6-8afe-7e2f47e0d978 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:33.833702 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8998e-4049-41f6-8afe-7e2f47e0d978 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:33.833987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8998e-4049-41f6-8afe-7e2f47e0d978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:33.860521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-31d8998e-4049-41f6-8afe-7e2f47e0d978 None None] MFA Rules not processed for user `c8d0c38e36f84be6a8169c08c8ed62ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:33.861744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-31d8998e-4049-41f6-8afe-7e2f47e0d978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:33.927957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 988/1966] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:21:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:21:33.938680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dec157-c8ef-43e8-bfeb-669ca30c9ff3 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:33.940420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e7dec157-c8ef-43e8-bfeb-669ca30c9ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:33.998551 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dec157-c8ef-43e8-bfeb-669ca30c9ff3 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:34.002519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acfc25-a42a-49e0-ba06-5bde323d3178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:34.003240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acfc25-a42a-49e0-ba06-5bde323d3178 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:34.004308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acfc25-a42a-49e0-ba06-5bde323d3178 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:34.004543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acfc25-a42a-49e0-ba06-5bde323d3178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:34.014208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acfc25-a42a-49e0-ba06-5bde323d3178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:34.015719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acfc25-a42a-49e0-ba06-5bde323d3178 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:34.025987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 979/1967] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:33 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:34.597368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8998e-4049-41f6-8afe-7e2f47e0d978 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:34.607216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8998e-4049-41f6-8afe-7e2f47e0d978 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:34.611000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a9776-5285-4ce4-a02b-a6d31f30cc47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:34.611650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9776-5285-4ce4-a02b-a6d31f30cc47 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:34.611958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9776-5285-4ce4-a02b-a6d31f30cc47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:34.612233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9776-5285-4ce4-a02b-a6d31f30cc47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:34.638963 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:34.668209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a9776-5285-4ce4-a02b-a6d31f30cc47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:34.669571 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a9776-5285-4ce4-a02b-a6d31f30cc47 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:34.678899 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 989/1968] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:21:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:21:44.021658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=49,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:44.722761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=15 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:11.068007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acfc25-a42a-49e0-ba06-5bde323d3178 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:11.069092 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-75acfc25-a42a-49e0-ba06-5bde323d3178 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:11.237089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acfc25-a42a-49e0-ba06-5bde323d3178 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:11.246514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:11.248767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:11.249067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:11.249344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] PATH_INFO: `/v3/users/d7910597d5d048f0aeaa1e251024513b` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:11.250732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7910597d5d048f0aeaa1e251024513b)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:11.252700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:11.571179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7910597d5d048f0aeaa1e251024513b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:11.670087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7910597d5d048f0aeaa1e251024513b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:11.684115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7910597d5d048f0aeaa1e251024513b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:11.684889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7910597d5d048f0aeaa1e251024513b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:11.692362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7910597d5d048f0aeaa1e251024513b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:11.700420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 980/1969] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:11 2022] DELETE /identity/v3/users/d7910597d5d048f0aeaa1e251024513b => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:11.706243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08cd8f-bdb0-4297-a41f-35dea4fbc898 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:11.706792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08cd8f-bdb0-4297-a41f-35dea4fbc898 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:11.706887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08cd8f-bdb0-4297-a41f-35dea4fbc898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:11.737308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8e08cd8f-bdb0-4297-a41f-35dea4fbc898 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:11.738683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8e08cd8f-bdb0-4297-a41f-35dea4fbc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:11.802780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 990/1970] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:11.812824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:11.814384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:11.840516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:11.934894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808d188-ac1b-48a6-88d3-a0255b83c07a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:11.937713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88985ea-690c-4fcf-9347-466f6c70de77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:11.938468 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88985ea-690c-4fcf-9347-466f6c70de77 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:11.938946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88985ea-690c-4fcf-9347-466f6c70de77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:11.939241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88985ea-690c-4fcf-9347-466f6c70de77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:11.950065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88985ea-690c-4fcf-9347-466f6c70de77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:11.951657 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88985ea-690c-4fcf-9347-466f6c70de77 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:11.963823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 981/1971] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:11.969429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08cd8f-bdb0-4297-a41f-35dea4fbc898 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:11.970872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8e08cd8f-bdb0-4297-a41f-35dea4fbc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:11.988675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08cd8f-bdb0-4297-a41f-35dea4fbc898 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:11.996489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:11.997395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:11.999835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:11.999835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] PATH_INFO: `/v3/users/13a1c3ab35c94de497b45435212d3ba8` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:11.999835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a1c3ab35c94de497b45435212d3ba8)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:12.001401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:12.255637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a1c3ab35c94de497b45435212d3ba8'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:12.367850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a1c3ab35c94de497b45435212d3ba8'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:12.384183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a1c3ab35c94de497b45435212d3ba8'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:12.387622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a1c3ab35c94de497b45435212d3ba8'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:12.396425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a1c3ab35c94de497b45435212d3ba8'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:12.404250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 991/1972] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:11 2022] DELETE /identity/v3/users/13a1c3ab35c94de497b45435212d3ba8 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:12.408830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9417-0cb8-4a24-8918-671f0f95e4ba None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:12.409308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9417-0cb8-4a24-8918-671f0f95e4ba None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:12.409410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d9417-0cb8-4a24-8918-671f0f95e4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:12.426837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-612d9417-0cb8-4a24-8918-671f0f95e4ba None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:12.428123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-612d9417-0cb8-4a24-8918-671f0f95e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:12.485960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:12.486205 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:12.500665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 982/1973] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:12.510898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d9417-0cb8-4a24-8918-671f0f95e4ba None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:12.512425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-612d9417-0cb8-4a24-8918-671f0f95e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:12.572277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876627-c532-4287-a61e-1491df10df23 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:12.578036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:12.579056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:12.579563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:12.579977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] PATH_INFO: `/v3/projects/b771b3811ca443d1a27cecbfda8c5a7e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:12.581365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b771b3811ca443d1a27cecbfda8c5a7e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:12.583566 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:12.584764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d9417-0cb8-4a24-8918-671f0f95e4ba None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:12.589159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e732e-26ed-4705-87c0-4d6e8666b8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:12.589159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e732e-26ed-4705-87c0-4d6e8666b8ac service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:12.589613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e732e-26ed-4705-87c0-4d6e8666b8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:12.589706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e732e-26ed-4705-87c0-4d6e8666b8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:12.596211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:12.599438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e732e-26ed-4705-87c0-4d6e8666b8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:12.600946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e732e-26ed-4705-87c0-4d6e8666b8ac service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:12.611328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 983/1974] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:22:12.830749 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b771b3811ca443d1a27cecbfda8c5a7e', 'request_id': 'req-d67c08cc-2722-4286-a55c-e28b412e28d1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:12.837524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b771b3811ca443d1a27cecbfda8c5a7e', 'request_id': 'req-d67c08cc-2722-4286-a55c-e28b412e28d1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:12.973280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b771b3811ca443d1a27cecbfda8c5a7e', 'request_id': 'req-d67c08cc-2722-4286-a55c-e28b412e28d1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:12.989306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] The token cache is being invalidate because project b771b3811ca443d1a27cecbfda8c5a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:12.989734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:12.990582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:12.993418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 992/1975] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:12 2022] DELETE /identity/v3/projects/b771b3811ca443d1a27cecbfda8c5a7e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:12.997344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e732e-26ed-4705-87c0-4d6e8666b8ac service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:13.011442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e732e-26ed-4705-87c0-4d6e8666b8ac service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:13.051193 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:13.083393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:13.084228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.084523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.084802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] PATH_INFO: `/v3/users/69c5c8b1bb434d2d9bf4b5ea280d9a51` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.086266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c5c8b1bb434d2d9bf4b5ea280d9a51)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:13.088819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:13.141693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:13.143355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:13.158044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c08cc-2722-4286-a55c-e28b412e28d1 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:13.162801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:13.163779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.164171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.164511 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] PATH_INFO: `/v3/projects/5af38c1e6aca4348a4b325e5b9417b81` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.166400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af38c1e6aca4348a4b325e5b9417b81)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:13.168726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:13.396270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c5c8b1bb434d2d9bf4b5ea280d9a51'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.399431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af38c1e6aca4348a4b325e5b9417b81', 'request_id': 'req-de307983-e2f8-4674-9ef0-a6a07f0fc405'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.406527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af38c1e6aca4348a4b325e5b9417b81', 'request_id': 'req-de307983-e2f8-4674-9ef0-a6a07f0fc405'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.511221 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c5c8b1bb434d2d9bf4b5ea280d9a51'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.523710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c5c8b1bb434d2d9bf4b5ea280d9a51'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.524372 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c5c8b1bb434d2d9bf4b5ea280d9a51'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.531642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c5c8b1bb434d2d9bf4b5ea280d9a51'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.537802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 984/1976] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:12 2022] DELETE /identity/v3/users/69c5c8b1bb434d2d9bf4b5ea280d9a51 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:13.636227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af38c1e6aca4348a4b325e5b9417b81', 'request_id': 'req-de307983-e2f8-4674-9ef0-a6a07f0fc405'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.647159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] The token cache is being invalidate because project 5af38c1e6aca4348a4b325e5b9417b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:13.647296 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.647969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.649524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 993/1977] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:13 2022] DELETE /identity/v3/projects/5af38c1e6aca4348a4b325e5b9417b81 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:13.654024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:13.655520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:13.725989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90946671-fa1e-4999-a36c-0a01371ac440 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:13.733919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:13.735045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.735425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.735816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] PATH_INFO: `/v3/users/c8d0c38e36f84be6a8169c08c8ed62ae` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.737289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d0c38e36f84be6a8169c08c8ed62ae)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:13.739550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:13.941750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d0c38e36f84be6a8169c08c8ed62ae'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:13.944245 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:13.964358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:13.965876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:14.038325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de307983-e2f8-4674-9ef0-a6a07f0fc405 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.042327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d0c38e36f84be6a8169c08c8ed62ae'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.043580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.044493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.044776 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.045054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] PATH_INFO: `/v3/projects/48964ff0ef154b83bff08ec2b63e56f8` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.046299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=48964ff0ef154b83bff08ec2b63e56f8)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.048290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.057782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d0c38e36f84be6a8169c08c8ed62ae'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.058809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d0c38e36f84be6a8169c08c8ed62ae'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.068371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1d6e93ca-6615-4fc0-ac9b-87127fbeff6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d0c38e36f84be6a8169c08c8ed62ae'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.072922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.081295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 985/1978] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:13 2022] DELETE /identity/v3/users/c8d0c38e36f84be6a8169c08c8ed62ae => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:14.192236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48964ff0ef154b83bff08ec2b63e56f8', 'request_id': 'req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.198424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48964ff0ef154b83bff08ec2b63e56f8', 'request_id': 'req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.350572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48964ff0ef154b83bff08ec2b63e56f8', 'request_id': 'req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.375717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] The token cache is being invalidate because project 48964ff0ef154b83bff08ec2b63e56f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:14.376363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.378105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f6efe9df-a4fb-4715-89af-2d9ec2a4bc2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.381477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 994/1979] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:13 2022] DELETE /identity/v3/projects/48964ff0ef154b83bff08ec2b63e56f8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:14.386263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c1260-5f28-45e7-b440-66b4666cae40 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.386652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c1260-5f28-45e7-b440-66b4666cae40 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.387040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c1260-5f28-45e7-b440-66b4666cae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.428703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-e59c1260-5f28-45e7-b440-66b4666cae40 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:14.429951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e59c1260-5f28-45e7-b440-66b4666cae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:14.493853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 986/1980] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:14.501750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e7661-db4f-43b1-8f55-e87b28094f3f None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.502129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e7661-db4f-43b1-8f55-e87b28094f3f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.502418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e7661-db4f-43b1-8f55-e87b28094f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.520805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8e1e7661-db4f-43b1-8f55-e87b28094f3f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:14.522070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8e1e7661-db4f-43b1-8f55-e87b28094f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:14.530645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 995/1981] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:14.535033 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c1260-5f28-45e7-b440-66b4666cae40 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.545543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c1260-5f28-45e7-b440-66b4666cae40 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.550111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f2681-1677-443d-9c9d-428f6194a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.550772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f2681-1677-443d-9c9d-428f6194a35b admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.551057 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f2681-1677-443d-9c9d-428f6194a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.551332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f2681-1677-443d-9c9d-428f6194a35b admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.552088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f2681-1677-443d-9c9d-428f6194a35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:14.552405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f2681-1677-443d-9c9d-428f6194a35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.553996 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f2681-1677-443d-9c9d-428f6194a35b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.565667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 987/1982] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:14.570029 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e7661-db4f-43b1-8f55-e87b28094f3f None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.580047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e7661-db4f-43b1-8f55-e87b28094f3f None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.585047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e815f-976f-4671-81a5-939b1adf3546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.585753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e815f-976f-4671-81a5-939b1adf3546 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.586298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e815f-976f-4671-81a5-939b1adf3546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.586571 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e815f-976f-4671-81a5-939b1adf3546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.587804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e815f-976f-4671-81a5-939b1adf3546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.589817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e815f-976f-4671-81a5-939b1adf3546 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.621159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f2681-1677-443d-9c9d-428f6194a35b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.623030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b48f2681-1677-443d-9c9d-428f6194a35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:14.637399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f2681-1677-443d-9c9d-428f6194a35b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.646413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.647292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.647580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.647867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] PATH_INFO: `/v3/projects/7e7020011f3745939e0b77b4c97efff1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.649225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7020011f3745939e0b77b4c97efff1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.651706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.706409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 996/1983] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:14 2022] POST /identity/v3/projects => generated 357 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:14.710587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e815f-976f-4671-81a5-939b1adf3546 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.772741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e815f-976f-4671-81a5-939b1adf3546 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.778007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa5308-4b29-454d-ae6f-178f10e8dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.778681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa5308-4b29-454d-ae6f-178f10e8dce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.778966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa5308-4b29-454d-ae6f-178f10e8dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.779243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa5308-4b29-454d-ae6f-178f10e8dce2 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.779984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa5308-4b29-454d-ae6f-178f10e8dce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.781903 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa5308-4b29-454d-ae6f-178f10e8dce2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.802809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7020011f3745939e0b77b4c97efff1', 'request_id': 'req-93c5428b-012e-4dda-9185-946f617ddbb7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.809386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7020011f3745939e0b77b4c97efff1', 'request_id': 'req-93c5428b-012e-4dda-9185-946f617ddbb7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.905667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 997/1984] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:14 2022] POST /identity/v3/users => generated 279 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:14.909585 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa5308-4b29-454d-ae6f-178f10e8dce2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.916094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7020011f3745939e0b77b4c97efff1', 'request_id': 'req-93c5428b-012e-4dda-9185-946f617ddbb7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.919688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa5308-4b29-454d-ae6f-178f10e8dce2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.930685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] The token cache is being invalidate because project 7e7020011f3745939e0b77b4c97efff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:14.930986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.931667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-93c5428b-012e-4dda-9185-946f617ddbb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:14.933287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 988/1985] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:14 2022] DELETE /identity/v3/projects/7e7020011f3745939e0b77b4c97efff1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:14.939702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c371-ae6e-4166-bae8-b2365a52fdcd None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.940120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c371-ae6e-4166-bae8-b2365a52fdcd None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.940436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c371-ae6e-4166-bae8-b2365a52fdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.958114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0a86c371-ae6e-4166-bae8-b2365a52fdcd None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:14.959450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0a86c371-ae6e-4166-bae8-b2365a52fdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:14.976598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813998e-ab83-499d-a97e-5609176d869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.977303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813998e-ab83-499d-a97e-5609176d869f admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.977615 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813998e-ab83-499d-a97e-5609176d869f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.978297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813998e-ab83-499d-a97e-5609176d869f admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.978687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.978830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813998e-ab83-499d-a97e-5609176d869f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.980481 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813998e-ab83-499d-a97e-5609176d869f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.990806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 998/1986] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:14.994723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813998e-ab83-499d-a97e-5609176d869f admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.996520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3813998e-ab83-499d-a97e-5609176d869f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:15.009884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813998e-ab83-499d-a97e-5609176d869f admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.014630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f842a17-a027-412e-b6bb-8172d54b3930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.018052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f842a17-a027-412e-b6bb-8172d54b3930 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.018052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f842a17-a027-412e-b6bb-8172d54b3930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.018052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f842a17-a027-412e-b6bb-8172d54b3930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.018052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f842a17-a027-412e-b6bb-8172d54b3930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.018353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f842a17-a027-412e-b6bb-8172d54b3930 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.019710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:15.021149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 989/1987] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:15.029654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5e8c7-3238-4ae3-9584-fa577fd6cc76 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.029868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5e8c7-3238-4ae3-9584-fa577fd6cc76 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.030146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5e8c7-3238-4ae3-9584-fa577fd6cc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.030661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 999/1988] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:15.034696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f842a17-a027-412e-b6bb-8172d54b3930 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.044610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f842a17-a027-412e-b6bb-8172d54b3930 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.048359 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-adf5e8c7-3238-4ae3-9584-fa577fd6cc76 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:15.049227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3b793-068d-4654-93cf-a06899e5e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.049563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-adf5e8c7-3238-4ae3-9584-fa577fd6cc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:15.050130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3b793-068d-4654-93cf-a06899e5e922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.050412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3b793-068d-4654-93cf-a06899e5e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.050684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3b793-068d-4654-93cf-a06899e5e922 admin admin] PATH_INFO: `/v3/projects/8df41c0b3dd24a30a1f72ad7e95191ba/users/2009db58af5541b7b8dc813076122e9f/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.057541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 990/1989] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:15.061597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5e8c7-3238-4ae3-9584-fa577fd6cc76 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.065364 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3b793-068d-4654-93cf-a06899e5e922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df41c0b3dd24a30a1f72ad7e95191ba, user_id=2009db58af5541b7b8dc813076122e9f, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.068327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3b793-068d-4654-93cf-a06899e5e922 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.070269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5e8c7-3238-4ae3-9584-fa577fd6cc76 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.075996 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603b81d-c3ec-46a5-86b9-a39c785d3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.081990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603b81d-c3ec-46a5-86b9-a39c785d3458 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.081990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603b81d-c3ec-46a5-86b9-a39c785d3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.081990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603b81d-c3ec-46a5-86b9-a39c785d3458 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.081990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603b81d-c3ec-46a5-86b9-a39c785d3458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:15.081990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603b81d-c3ec-46a5-86b9-a39c785d3458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.081990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603b81d-c3ec-46a5-86b9-a39c785d3458 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.092683 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 991/1990] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:15.096944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603b81d-c3ec-46a5-86b9-a39c785d3458 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.107865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603b81d-c3ec-46a5-86b9-a39c785d3458 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.112509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97208a-c0e3-4050-adb1-93e37bafa2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.113153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97208a-c0e3-4050-adb1-93e37bafa2db admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.113440 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97208a-c0e3-4050-adb1-93e37bafa2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.113786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97208a-c0e3-4050-adb1-93e37bafa2db admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.114480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97208a-c0e3-4050-adb1-93e37bafa2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.116438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97208a-c0e3-4050-adb1-93e37bafa2db admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.150413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1000/1991] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:15 2022] PUT /identity/v3/projects/8df41c0b3dd24a30a1f72ad7e95191ba/users/2009db58af5541b7b8dc813076122e9f/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:15.160525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af8f14-0634-439c-b966-4923b0625404 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.160832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af8f14-0634-439c-b966-4923b0625404 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.161108 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af8f14-0634-439c-b966-4923b0625404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.188286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-e0af8f14-0634-439c-b966-4923b0625404 None None] MFA Rules not processed for user `2009db58af5541b7b8dc813076122e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:15.189504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e0af8f14-0634-439c-b966-4923b0625404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:15.241135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 992/1992] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:15 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:15.242647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97208a-c0e3-4050-adb1-93e37bafa2db admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.252485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1001/1993] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:15 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:15.256751 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af8f14-0634-439c-b966-4923b0625404 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.330952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af8f14-0634-439c-b966-4923b0625404 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.332792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97208a-c0e3-4050-adb1-93e37bafa2db admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.339959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09ad8-8b8a-4c45-89e2-fda36f826d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.339959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09ad8-8b8a-4c45-89e2-fda36f826d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.339959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09ad8-8b8a-4c45-89e2-fda36f826d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.339959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09ad8-8b8a-4c45-89e2-fda36f826d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.340267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b91263-a6ff-4cef-b115-96ab12205674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.340392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab09ad8-8b8a-4c45-89e2-fda36f826d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.340493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b91263-a6ff-4cef-b115-96ab12205674 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.340493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b91263-a6ff-4cef-b115-96ab12205674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.340493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b91263-a6ff-4cef-b115-96ab12205674 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.340493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b91263-a6ff-4cef-b115-96ab12205674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.340796 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab09ad8-8b8a-4c45-89e2-fda36f826d8d admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.341454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b91263-a6ff-4cef-b115-96ab12205674 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.433184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 993/1994] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:15 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:15.474001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b91263-a6ff-4cef-b115-96ab12205674 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.474001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b91263-a6ff-4cef-b115-96ab12205674 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.474001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928bf9b-42d7-4b78-94a8-52ab38c52c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.474001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928bf9b-42d7-4b78-94a8-52ab38c52c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.474379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928bf9b-42d7-4b78-94a8-52ab38c52c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.474379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928bf9b-42d7-4b78-94a8-52ab38c52c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.474379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928bf9b-42d7-4b78-94a8-52ab38c52c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.474379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928bf9b-42d7-4b78-94a8-52ab38c52c7d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.476462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 994/1995] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:15.480294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928bf9b-42d7-4b78-94a8-52ab38c52c7d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.490362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928bf9b-42d7-4b78-94a8-52ab38c52c7d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.504339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51497c-a442-4351-a828-1ee02ce76c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.525063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51497c-a442-4351-a828-1ee02ce76c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.525063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51497c-a442-4351-a828-1ee02ce76c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.525063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51497c-a442-4351-a828-1ee02ce76c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.525336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1002/1996] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:15 2022] POST /identity/v3/projects => generated 357 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:15.525424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51497c-a442-4351-a828-1ee02ce76c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.525424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51497c-a442-4351-a828-1ee02ce76c0c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.525424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 995/1997] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:15.529554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09ad8-8b8a-4c45-89e2-fda36f826d8d admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.537453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51497c-a442-4351-a828-1ee02ce76c0c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.551100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51497c-a442-4351-a828-1ee02ce76c0c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.603481 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:15.606009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:15.617558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfadfd-2da0-440f-b0ee-ec736ac54953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.617964 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09ad8-8b8a-4c45-89e2-fda36f826d8d admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.618465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfadfd-2da0-440f-b0ee-ec736ac54953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.619338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfadfd-2da0-440f-b0ee-ec736ac54953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.619622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfadfd-2da0-440f-b0ee-ec736ac54953 admin admin] PATH_INFO: `/v3/projects/31fa1be11da94b1bb60d35198bdecf3b/users/fb52d81f382247cbb63e6c78d5196ae7/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.623363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349144c-48a5-40af-b79b-76f7b9aaf1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.624068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349144c-48a5-40af-b79b-76f7b9aaf1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.624354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349144c-48a5-40af-b79b-76f7b9aaf1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.624629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349144c-48a5-40af-b79b-76f7b9aaf1e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.625330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349144c-48a5-40af-b79b-76f7b9aaf1e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.627272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349144c-48a5-40af-b79b-76f7b9aaf1e5 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.634005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfadfd-2da0-440f-b0ee-ec736ac54953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fa1be11da94b1bb60d35198bdecf3b, user_id=fb52d81f382247cbb63e6c78d5196ae7, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.636827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfadfd-2da0-440f-b0ee-ec736ac54953 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.745678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1003/1998] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:15 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:15.750424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349144c-48a5-40af-b79b-76f7b9aaf1e5 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.758325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 996/1999] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:15 2022] PUT /identity/v3/projects/31fa1be11da94b1bb60d35198bdecf3b/users/fb52d81f382247cbb63e6c78d5196ae7/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:15.769061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349144c-48a5-40af-b79b-76f7b9aaf1e5 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.769336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3581e-6fd7-48cf-91e8-19f2a2c3cdd5 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.769754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3581e-6fd7-48cf-91e8-19f2a2c3cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.770144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3581e-6fd7-48cf-91e8-19f2a2c3cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.804564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-5be3581e-6fd7-48cf-91e8-19f2a2c3cdd5 None None] MFA Rules not processed for user `fb52d81f382247cbb63e6c78d5196ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:15.805839 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5be3581e-6fd7-48cf-91e8-19f2a2c3cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:15.860594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51300a-9975-442a-b7af-1577936598e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.861897 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51300a-9975-442a-b7af-1577936598e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.862462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51300a-9975-442a-b7af-1577936598e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.863050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51300a-9975-442a-b7af-1577936598e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.864761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51300a-9975-442a-b7af-1577936598e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.867788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51300a-9975-442a-b7af-1577936598e2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.904086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1004/2000] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:15.904086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51300a-9975-442a-b7af-1577936598e2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.904702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 997/2001] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:15.908228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51300a-9975-442a-b7af-1577936598e2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.909443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3581e-6fd7-48cf-91e8-19f2a2c3cdd5 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.910835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5be3581e-6fd7-48cf-91e8-19f2a2c3cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:15.915126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad904dd1-3181-486e-a8bc-1339be59da9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.916865 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad904dd1-3181-486e-a8bc-1339be59da9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.917323 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad904dd1-3181-486e-a8bc-1339be59da9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.917781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad904dd1-3181-486e-a8bc-1339be59da9e admin admin] PATH_INFO: `/v3/projects/a6aab1f1786744219e36a71211c25478/users/e6c218b4bfc04b5db1d37f085596a1e9/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.936938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad904dd1-3181-486e-a8bc-1339be59da9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6aab1f1786744219e36a71211c25478, user_id=e6c218b4bfc04b5db1d37f085596a1e9, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.939734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad904dd1-3181-486e-a8bc-1339be59da9e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.976776 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3581e-6fd7-48cf-91e8-19f2a2c3cdd5 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.980941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9981b8-ec5e-448c-8009-aa796ca03543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.981593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9981b8-ec5e-448c-8009-aa796ca03543 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.981884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9981b8-ec5e-448c-8009-aa796ca03543 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.982161 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9981b8-ec5e-448c-8009-aa796ca03543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.990303 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9981b8-ec5e-448c-8009-aa796ca03543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.991753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9981b8-ec5e-448c-8009-aa796ca03543 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:16.001941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 998/2002] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:16.045283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1005/2003] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:15 2022] PUT /identity/v3/projects/a6aab1f1786744219e36a71211c25478/users/e6c218b4bfc04b5db1d37f085596a1e9/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:16.049757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9981b8-ec5e-448c-8009-aa796ca03543 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:16.061034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9981b8-ec5e-448c-8009-aa796ca03543 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:16.118946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5373853-a503-4ead-9d00-7da342bdb840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:16.119661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5373853-a503-4ead-9d00-7da342bdb840 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:16.119988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5373853-a503-4ead-9d00-7da342bdb840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:16.120274 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5373853-a503-4ead-9d00-7da342bdb840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:16.121017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5373853-a503-4ead-9d00-7da342bdb840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:16.122609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5373853-a503-4ead-9d00-7da342bdb840 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:16.127953 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:16.136399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 999/2004] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:16.137887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad904dd1-3181-486e-a8bc-1339be59da9e admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:16.148328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad904dd1-3181-486e-a8bc-1339be59da9e admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:16.153913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ae172-6dfa-4b8c-a7d5-1ea0f2455393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:16.154796 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ae172-6dfa-4b8c-a7d5-1ea0f2455393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:16.155072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ae172-6dfa-4b8c-a7d5-1ea0f2455393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:16.155341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ae172-6dfa-4b8c-a7d5-1ea0f2455393 admin admin] PATH_INFO: `/v3/projects/a6aab1f1786744219e36a71211c25478/users/e6c218b4bfc04b5db1d37f085596a1e9/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:16.157357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ae172-6dfa-4b8c-a7d5-1ea0f2455393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6aab1f1786744219e36a71211c25478, user_id=e6c218b4bfc04b5db1d37f085596a1e9, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:16.160574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ae172-6dfa-4b8c-a7d5-1ea0f2455393 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:16.171332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1006/2005] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:16 2022] PUT /identity/v3/projects/a6aab1f1786744219e36a71211c25478/users/e6c218b4bfc04b5db1d37f085596a1e9/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:16.182521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cdac6-e56c-4950-9fbf-d482254ae478 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:16.182814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cdac6-e56c-4950-9fbf-d482254ae478 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:16.183106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cdac6-e56c-4950-9fbf-d482254ae478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:16.210399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0e9cdac6-e56c-4950-9fbf-d482254ae478 None None] MFA Rules not processed for user `e6c218b4bfc04b5db1d37f085596a1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:16.212033 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0e9cdac6-e56c-4950-9fbf-d482254ae478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:16.284261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1000/2006] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:16 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:16.295343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ae172-6dfa-4b8c-a7d5-1ea0f2455393 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:16.297152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d18ae172-6dfa-4b8c-a7d5-1ea0f2455393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:16.362315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ae172-6dfa-4b8c-a7d5-1ea0f2455393 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:16.367078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e568d-af04-4ab8-b410-e5c912c400dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:16.367765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e568d-af04-4ab8-b410-e5c912c400dd service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:16.368083 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e568d-af04-4ab8-b410-e5c912c400dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:16.368365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e568d-af04-4ab8-b410-e5c912c400dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:16.382145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e568d-af04-4ab8-b410-e5c912c400dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:16.385354 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e568d-af04-4ab8-b410-e5c912c400dd service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:16.400707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1007/2007] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:16 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:16.775193 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cdac6-e56c-4950-9fbf-d482254ae478 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:16.784590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cdac6-e56c-4950-9fbf-d482254ae478 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:16.794778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5887d9a-3c80-4dd9-a651-7dc2edc6553b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:16.794778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5887d9a-3c80-4dd9-a651-7dc2edc6553b service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:16.794778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5887d9a-3c80-4dd9-a651-7dc2edc6553b service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:16.794778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5887d9a-3c80-4dd9-a651-7dc2edc6553b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:16.845228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5887d9a-3c80-4dd9-a651-7dc2edc6553b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:16.846661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5887d9a-3c80-4dd9-a651-7dc2edc6553b service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:16.855912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1001/2008] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:16 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:19.041164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2499795-cf7b-4f75-9135-2602fed2f814 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.041728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2499795-cf7b-4f75-9135-2602fed2f814 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.042050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2499795-cf7b-4f75-9135-2602fed2f814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.062015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-e2499795-cf7b-4f75-9135-2602fed2f814 None None] MFA Rules not processed for user `fb52d81f382247cbb63e6c78d5196ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:19.063648 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e2499795-cf7b-4f75-9135-2602fed2f814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:19.102398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:19.127594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1008/2009] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:26.851432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=62 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.315814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=8 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.810026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5887d9a-3c80-4dd9-a651-7dc2edc6553b service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:29.812128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a5887d9a-3c80-4dd9-a651-7dc2edc6553b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:29.957141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5887d9a-3c80-4dd9-a651-7dc2edc6553b service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:29.972483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:29.972483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.972483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.972483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] PATH_INFO: `/v3/users/eb4e3e014c0a43429edd73ec715b1c47` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.972813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4e3e014c0a43429edd73ec715b1c47)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:29.973647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:30.254483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4e3e014c0a43429edd73ec715b1c47'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:30.362606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4e3e014c0a43429edd73ec715b1c47'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:30.387586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4e3e014c0a43429edd73ec715b1c47'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:30.388507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4e3e014c0a43429edd73ec715b1c47'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:30.401371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4e3e014c0a43429edd73ec715b1c47'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:30.408917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1002/2010] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:29 2022] DELETE /identity/v3/users/eb4e3e014c0a43429edd73ec715b1c47 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:30.413614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ab4a0-1803-4a2a-a483-103493609513 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.414086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ab4a0-1803-4a2a-a483-103493609513 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.414423 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ab4a0-1803-4a2a-a483-103493609513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.433466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-6d0ab4a0-1803-4a2a-a483-103493609513 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:30.434914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6d0ab4a0-1803-4a2a-a483-103493609513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:30.499842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1009/2011] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:30.514025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:30.518109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:30.592223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c6bfb-26c9-4a6c-aaa3-dd40d1ee3af8 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:30.592223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70ae71-df79-4650-b508-60689b26c92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:30.592591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70ae71-df79-4650-b508-60689b26c92d service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.592806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70ae71-df79-4650-b508-60689b26c92d service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.593020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70ae71-df79-4650-b508-60689b26c92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.604083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70ae71-df79-4650-b508-60689b26c92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:30.606621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70ae71-df79-4650-b508-60689b26c92d service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:30.619430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1003/2012] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:30.768151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ab4a0-1803-4a2a-a483-103493609513 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:30.770642 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6d0ab4a0-1803-4a2a-a483-103493609513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:30.788930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ab4a0-1803-4a2a-a483-103493609513 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:30.797414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:30.798570 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.799337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.800594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] PATH_INFO: `/v3/users/ec360e4110884dda8a6bba70dd02b332` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.802309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec360e4110884dda8a6bba70dd02b332)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:30.804842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:31.082488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec360e4110884dda8a6bba70dd02b332'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:31.161814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec360e4110884dda8a6bba70dd02b332'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:31.175422 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec360e4110884dda8a6bba70dd02b332'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:31.176278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec360e4110884dda8a6bba70dd02b332'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:31.187775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec360e4110884dda8a6bba70dd02b332'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:31.194540 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1010/2013] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:30 2022] DELETE /identity/v3/users/ec360e4110884dda8a6bba70dd02b332 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:31.199721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d844-fcec-4945-9fdb-a2ffde1ee1ac None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:31.200286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d844-fcec-4945-9fdb-a2ffde1ee1ac None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:31.200497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d844-fcec-4945-9fdb-a2ffde1ee1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:31.217960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-7953d844-fcec-4945-9fdb-a2ffde1ee1ac None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:31.219169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7953d844-fcec-4945-9fdb-a2ffde1ee1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:31.259305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:31.260342 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:31.261854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:31.335200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1004/2014] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:31.345395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953d844-fcec-4945-9fdb-a2ffde1ee1ac None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:31.346990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7953d844-fcec-4945-9fdb-a2ffde1ee1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:31.364559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d168123-0fc4-44f5-b585-ea8acc051d04 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:31.369902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:31.371484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:31.371839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:31.372221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] PATH_INFO: `/v3/projects/2f7c196500524b6aa97455e56962baec` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:31.376646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f7c196500524b6aa97455e56962baec)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:31.386508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:31.400952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:31.419378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953d844-fcec-4945-9fdb-a2ffde1ee1ac None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:31.423339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1194b45-4697-4f10-9a68-46f6f78ae67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:31.424060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194b45-4697-4f10-9a68-46f6f78ae67e service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:31.424347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194b45-4697-4f10-9a68-46f6f78ae67e service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:31.424625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194b45-4697-4f10-9a68-46f6f78ae67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:31.434349 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1194b45-4697-4f10-9a68-46f6f78ae67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:31.435802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1194b45-4697-4f10-9a68-46f6f78ae67e service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:31.445229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1005/2015] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:22:31.517518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f7c196500524b6aa97455e56962baec', 'request_id': 'req-ff4ed539-82e5-4457-b180-16d1502643c7'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:31.523708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f7c196500524b6aa97455e56962baec', 'request_id': 'req-ff4ed539-82e5-4457-b180-16d1502643c7'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:31.619243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f7c196500524b6aa97455e56962baec', 'request_id': 'req-ff4ed539-82e5-4457-b180-16d1502643c7'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:31.630139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] The token cache is being invalidate because project 2f7c196500524b6aa97455e56962baec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:31.630430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:31.631088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ff4ed539-82e5-4457-b180-16d1502643c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:31.632699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1011/2016] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:31 2022] DELETE /identity/v3/projects/2f7c196500524b6aa97455e56962baec => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:31.637902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ea1b6-0719-431d-8f8d-63aeda572c89 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:31.638199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ea1b6-0719-431d-8f8d-63aeda572c89 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:31.638478 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ea1b6-0719-431d-8f8d-63aeda572c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:31.675962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d29ea1b6-0719-431d-8f8d-63aeda572c89 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:31.677254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d29ea1b6-0719-431d-8f8d-63aeda572c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:31.755960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1006/2017] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:31.764276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1cebd-5a35-4b3e-a947-c31da2080197 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:31.764770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1cebd-5a35-4b3e-a947-c31da2080197 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:31.765518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1cebd-5a35-4b3e-a947-c31da2080197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:31.802054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-86d1cebd-5a35-4b3e-a947-c31da2080197 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:31.803607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-86d1cebd-5a35-4b3e-a947-c31da2080197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:31.821380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1012/2018] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:31.825492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ea1b6-0719-431d-8f8d-63aeda572c89 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:31.836760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ea1b6-0719-431d-8f8d-63aeda572c89 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:31.842317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1acca-1060-4815-b865-9c27dfe41e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:31.843210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1acca-1060-4815-b865-9c27dfe41e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:31.843912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1acca-1060-4815-b865-9c27dfe41e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:31.844214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1acca-1060-4815-b865-9c27dfe41e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:31.844951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1acca-1060-4815-b865-9c27dfe41e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:31.845264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1acca-1060-4815-b865-9c27dfe41e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:31.846905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1acca-1060-4815-b865-9c27dfe41e55 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:31.859673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1007/2019] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:31.875347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1cebd-5a35-4b3e-a947-c31da2080197 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:31.884881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1cebd-5a35-4b3e-a947-c31da2080197 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:31.890427 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c81364-893d-4fe7-93f2-b33dbd711e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:31.891100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c81364-893d-4fe7-93f2-b33dbd711e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:31.891390 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c81364-893d-4fe7-93f2-b33dbd711e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:31.891672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c81364-893d-4fe7-93f2-b33dbd711e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:31.892405 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c81364-893d-4fe7-93f2-b33dbd711e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:31.894320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c81364-893d-4fe7-93f2-b33dbd711e69 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:32.042460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1acca-1060-4815-b865-9c27dfe41e55 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:32.044228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b6c1acca-1060-4815-b865-9c27dfe41e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:32.059170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1acca-1060-4815-b865-9c27dfe41e55 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:32.063832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:32.064726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.065008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.065337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] PATH_INFO: `/v3/projects/b97247e2dae049e0890954ae18eb0af6` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.066442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97247e2dae049e0890954ae18eb0af6)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:32.068363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:32.097734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1013/2020] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:31 2022] POST /identity/v3/projects => generated 371 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:32.106816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c81364-893d-4fe7-93f2-b33dbd711e69 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:32.165448 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c81364-893d-4fe7-93f2-b33dbd711e69 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:32.184378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad25d5-dfc7-4e59-85bf-1d704e67dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:32.184378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad25d5-dfc7-4e59-85bf-1d704e67dc24 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.184378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad25d5-dfc7-4e59-85bf-1d704e67dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.184378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad25d5-dfc7-4e59-85bf-1d704e67dc24 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.185029 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad25d5-dfc7-4e59-85bf-1d704e67dc24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:32.185029 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad25d5-dfc7-4e59-85bf-1d704e67dc24 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:32.232807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97247e2dae049e0890954ae18eb0af6', 'request_id': 'req-3c89ab23-e081-447b-8179-0d8ea28cc6bf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:32.239754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97247e2dae049e0890954ae18eb0af6', 'request_id': 'req-3c89ab23-e081-447b-8179-0d8ea28cc6bf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:32.334831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1014/2021] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:32 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:32.338496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad25d5-dfc7-4e59-85bf-1d704e67dc24 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:32.350505 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad25d5-dfc7-4e59-85bf-1d704e67dc24 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:32.352035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97247e2dae049e0890954ae18eb0af6', 'request_id': 'req-3c89ab23-e081-447b-8179-0d8ea28cc6bf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:32.369111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] The token cache is being invalidate because project b97247e2dae049e0890954ae18eb0af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:32.369414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:32.370119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:32.372780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1008/2022] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:32 2022] DELETE /identity/v3/projects/b97247e2dae049e0890954ae18eb0af6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:32.381958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:32.381958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:32.441981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331cbcd-7451-46cb-805c-08d86b32399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:32.442680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331cbcd-7451-46cb-805c-08d86b32399e admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.442877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331cbcd-7451-46cb-805c-08d86b32399e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.443797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331cbcd-7451-46cb-805c-08d86b32399e admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.444006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331cbcd-7451-46cb-805c-08d86b32399e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:32.445835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331cbcd-7451-46cb-805c-08d86b32399e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:32.463709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1015/2023] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:32.464873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331cbcd-7451-46cb-805c-08d86b32399e admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:32.466747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b331cbcd-7451-46cb-805c-08d86b32399e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:32.481000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331cbcd-7451-46cb-805c-08d86b32399e admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:32.485859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89ab23-e081-447b-8179-0d8ea28cc6bf admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:32.486227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9580c78-bf18-4cea-b13f-593f65b602fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:32.486913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9580c78-bf18-4cea-b13f-593f65b602fd admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.487254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9580c78-bf18-4cea-b13f-593f65b602fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.487537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9580c78-bf18-4cea-b13f-593f65b602fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.488400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9580c78-bf18-4cea-b13f-593f65b602fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:32.490312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9580c78-bf18-4cea-b13f-593f65b602fd admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:32.500147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:32.501322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.501729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.502114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] PATH_INFO: `/v3/users/b981456fc5974e5fb31ef4bab75da843` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.503670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b981456fc5974e5fb31ef4bab75da843)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:32.505112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1016/2024] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:32.506061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9580c78-bf18-4cea-b13f-593f65b602fd admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:32.507104 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:32.516972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9580c78-bf18-4cea-b13f-593f65b602fd admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:32.523039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08372139-a521-4135-9a66-ad79bcffd70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:32.523979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08372139-a521-4135-9a66-ad79bcffd70a admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.524261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08372139-a521-4135-9a66-ad79bcffd70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.524534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08372139-a521-4135-9a66-ad79bcffd70a admin admin] PATH_INFO: `/v3/projects/baedcc2ca99b4a769e1d47f08128cee6/users/b4f6d82897df4c9bb85b10f53e79100a/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.545171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08372139-a521-4135-9a66-ad79bcffd70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=baedcc2ca99b4a769e1d47f08128cee6, user_id=b4f6d82897df4c9bb85b10f53e79100a, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:32.548494 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08372139-a521-4135-9a66-ad79bcffd70a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:32.637289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1017/2025] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:32 2022] PUT /identity/v3/projects/baedcc2ca99b4a769e1d47f08128cee6/users/b4f6d82897df4c9bb85b10f53e79100a/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:32.647837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a028a-cbec-4cc4-8811-cbfa0f76778f None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.648188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a028a-cbec-4cc4-8811-cbfa0f76778f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.648469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a028a-cbec-4cc4-8811-cbfa0f76778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.687135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-1d2a028a-cbec-4cc4-8811-cbfa0f76778f None None] MFA Rules not processed for user `b4f6d82897df4c9bb85b10f53e79100a`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:32.689690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1d2a028a-cbec-4cc4-8811-cbfa0f76778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:32.757422 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1018/2026] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:32.758501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a028a-cbec-4cc4-8811-cbfa0f76778f None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:32.759736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1d2a028a-cbec-4cc4-8811-cbfa0f76778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:32.826211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a028a-cbec-4cc4-8811-cbfa0f76778f None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:32.831378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:32.832706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.832997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.833265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] PATH_INFO: `/v3/users/ecc1e634407749c7a64fd2c10f9a8347` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.834828 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc1e634407749c7a64fd2c10f9a8347)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:32.837130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:32.850467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b981456fc5974e5fb31ef4bab75da843'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:32.946833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b981456fc5974e5fb31ef4bab75da843'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:32.962352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b981456fc5974e5fb31ef4bab75da843'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:32.963178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b981456fc5974e5fb31ef4bab75da843'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:32.972517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b981456fc5974e5fb31ef4bab75da843'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:32.979072 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1009/2027] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:32 2022] DELETE /identity/v3/users/b981456fc5974e5fb31ef4bab75da843 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:32.982837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:32.982837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:33.030148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc1e634407749c7a64fd2c10f9a8347'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.047116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4f3ad-4f3d-4a1d-bd48-7939858653c8 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.051989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ab696-6d03-4484-b30a-5a11830502f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '979519f42f7d463bb2ee1d5b0bb72a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.053393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ab696-6d03-4484-b30a-5a11830502f1 service glance] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.053393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ab696-6d03-4484-b30a-5a11830502f1 service glance] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.053393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ab696-6d03-4484-b30a-5a11830502f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.055067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-511ab696-6d03-4484-b30a-5a11830502f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:33.105585 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc1e634407749c7a64fd2c10f9a8347'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.115209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ab696-6d03-4484-b30a-5a11830502f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:33.116757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ab696-6d03-4484-b30a-5a11830502f1 service glance] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:33.117786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc1e634407749c7a64fd2c10f9a8347'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.118475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc1e634407749c7a64fd2c10f9a8347'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.125310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc1e634407749c7a64fd2c10f9a8347'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.125907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1010/2028] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:33.134524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1019/2029] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:32 2022] DELETE /identity/v3/users/ecc1e634407749c7a64fd2c10f9a8347 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:33.462391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ab696-6d03-4484-b30a-5a11830502f1 service glance] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.467011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-511ab696-6d03-4484-b30a-5a11830502f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:33.504939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.512871 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.515049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:33.566030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ab696-6d03-4484-b30a-5a11830502f1 service glance] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.599420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dec75a-3763-4ade-89e2-9303688df70a admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.604586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.606169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.606468 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.607167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] PATH_INFO: `/v3/projects/f01e7d1f04774a75a4c325aade5344a1` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.608674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01e7d1f04774a75a4c325aade5344a1)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:33.610385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.613220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:33.628277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.629156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.629438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.629714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] PATH_INFO: `/v3/projects/7aa4ef26a34e4e35a343427df4a8f0ef` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.630907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa4ef26a34e4e35a343427df4a8f0ef)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:33.632865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:33.799310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01e7d1f04774a75a4c325aade5344a1', 'request_id': 'req-f21fdf61-8081-46f6-bf87-2f87c3b8703a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.800702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa4ef26a34e4e35a343427df4a8f0ef', 'request_id': 'req-5a5b9ab3-e6dd-4283-93da-323289419a2d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.807553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa4ef26a34e4e35a343427df4a8f0ef', 'request_id': 'req-5a5b9ab3-e6dd-4283-93da-323289419a2d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.808295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01e7d1f04774a75a4c325aade5344a1', 'request_id': 'req-f21fdf61-8081-46f6-bf87-2f87c3b8703a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.910949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa4ef26a34e4e35a343427df4a8f0ef', 'request_id': 'req-5a5b9ab3-e6dd-4283-93da-323289419a2d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.922144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] The token cache is being invalidate because project 7aa4ef26a34e4e35a343427df4a8f0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:33.922431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.923044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-5a5b9ab3-e6dd-4283-93da-323289419a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:33.924664 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1011/2030] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:33 2022] DELETE /identity/v3/projects/7aa4ef26a34e4e35a343427df4a8f0ef => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:33.935492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad5146-30fa-4b37-8ec6-780bd0dd5065 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.935780 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad5146-30fa-4b37-8ec6-780bd0dd5065 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.936110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad5146-30fa-4b37-8ec6-780bd0dd5065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.953792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-e9ad5146-30fa-4b37-8ec6-780bd0dd5065 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:33.954983 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e9ad5146-30fa-4b37-8ec6-780bd0dd5065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:34.017094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1012/2031] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:34.024185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c75a-8bd2-46f3-84a3-b3e8c8ee91f1 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.027508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c75a-8bd2-46f3-84a3-b3e8c8ee91f1 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.027508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6c75a-8bd2-46f3-84a3-b3e8c8ee91f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.045758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f2f6c75a-8bd2-46f3-84a3-b3e8c8ee91f1 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:34.047118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f2f6c75a-8bd2-46f3-84a3-b3e8c8ee91f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:34.049098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01e7d1f04774a75a4c325aade5344a1', 'request_id': 'req-f21fdf61-8081-46f6-bf87-2f87c3b8703a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:34.055847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1013/2032] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:34.060291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c75a-8bd2-46f3-84a3-b3e8c8ee91f1 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.065951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] The token cache is being invalidate because project f01e7d1f04774a75a4c325aade5344a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:34.066466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:34.067138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f21fdf61-8081-46f6-bf87-2f87c3b8703a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:34.069668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1020/2033] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:33 2022] DELETE /identity/v3/projects/f01e7d1f04774a75a4c325aade5344a1 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:34.070844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6c75a-8bd2-46f3-84a3-b3e8c8ee91f1 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.074375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524ef8-4faa-4e36-98e0-8bf7017253fa None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.074729 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524ef8-4faa-4e36-98e0-8bf7017253fa None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.075004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524ef8-4faa-4e36-98e0-8bf7017253fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.075948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b27fe-5b7c-4c98-beb7-eeebac31804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.076673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b27fe-5b7c-4c98-beb7-eeebac31804f admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.077092 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b27fe-5b7c-4c98-beb7-eeebac31804f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.077447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b27fe-5b7c-4c98-beb7-eeebac31804f admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.078109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b27fe-5b7c-4c98-beb7-eeebac31804f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:34.078419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b27fe-5b7c-4c98-beb7-eeebac31804f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.080106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b27fe-5b7c-4c98-beb7-eeebac31804f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.096271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-cb524ef8-4faa-4e36-98e0-8bf7017253fa None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:34.097530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1014/2034] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:34.100039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-cb524ef8-4faa-4e36-98e0-8bf7017253fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:34.101914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b27fe-5b7c-4c98-beb7-eeebac31804f admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.103924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-532b27fe-5b7c-4c98-beb7-eeebac31804f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:34.110568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1021/2035] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:34.118450 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd111a-1032-42af-b72d-a7d5151c056e None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.118736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd111a-1032-42af-b72d-a7d5151c056e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.119014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd111a-1032-42af-b72d-a7d5151c056e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.119425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b27fe-5b7c-4c98-beb7-eeebac31804f admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.124325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45683ab0-6d72-45ba-bfdb-cdaef5d339c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.125004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45683ab0-6d72-45ba-bfdb-cdaef5d339c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.125431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45683ab0-6d72-45ba-bfdb-cdaef5d339c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.125724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45683ab0-6d72-45ba-bfdb-cdaef5d339c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.126473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45683ab0-6d72-45ba-bfdb-cdaef5d339c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.128519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45683ab0-6d72-45ba-bfdb-cdaef5d339c4 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.138899 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-58fd111a-1032-42af-b72d-a7d5151c056e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:34.140245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-58fd111a-1032-42af-b72d-a7d5151c056e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:34.149855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1022/2036] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:34.154422 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd111a-1032-42af-b72d-a7d5151c056e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.163802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd111a-1032-42af-b72d-a7d5151c056e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.169118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a3db0-476f-4694-9213-76641f14d8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.169814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a3db0-476f-4694-9213-76641f14d8ad admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.170099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a3db0-476f-4694-9213-76641f14d8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.170840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a3db0-476f-4694-9213-76641f14d8ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.171585 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a3db0-476f-4694-9213-76641f14d8ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:34.171911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a3db0-476f-4694-9213-76641f14d8ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.173551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a3db0-476f-4694-9213-76641f14d8ad admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.187288 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1023/2037] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:34.191654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a3db0-476f-4694-9213-76641f14d8ad admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.202116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a3db0-476f-4694-9213-76641f14d8ad admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.206982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbd032-07b2-45e5-b50f-53a3a9af57e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.208132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd032-07b2-45e5-b50f-53a3a9af57e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.208132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd032-07b2-45e5-b50f-53a3a9af57e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.208308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbd032-07b2-45e5-b50f-53a3a9af57e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.209088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbd032-07b2-45e5-b50f-53a3a9af57e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.210999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbd032-07b2-45e5-b50f-53a3a9af57e4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.230779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1015/2038] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:34 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:34.235520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45683ab0-6d72-45ba-bfdb-cdaef5d339c4 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.298292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45683ab0-6d72-45ba-bfdb-cdaef5d339c4 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.303357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543876b-40b7-42b5-a6a5-e36ab5089fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.304089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543876b-40b7-42b5-a6a5-e36ab5089fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.304374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543876b-40b7-42b5-a6a5-e36ab5089fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.304650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543876b-40b7-42b5-a6a5-e36ab5089fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.305413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543876b-40b7-42b5-a6a5-e36ab5089fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.307343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543876b-40b7-42b5-a6a5-e36ab5089fc4 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.344810 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1024/2039] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:34 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:34.345541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbd032-07b2-45e5-b50f-53a3a9af57e4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.418493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbd032-07b2-45e5-b50f-53a3a9af57e4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.429734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de11747-6b94-4648-948f-96a7730f39dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.430433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de11747-6b94-4648-948f-96a7730f39dd admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.430775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de11747-6b94-4648-948f-96a7730f39dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.431060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de11747-6b94-4648-948f-96a7730f39dd admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.431756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de11747-6b94-4648-948f-96a7730f39dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.432279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1016/2040] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:34 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:34.433835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de11747-6b94-4648-948f-96a7730f39dd admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.436214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543876b-40b7-42b5-a6a5-e36ab5089fc4 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.447900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543876b-40b7-42b5-a6a5-e36ab5089fc4 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.453446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0c0c6-c1ca-4b8e-add3-32926ef676c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.454124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0c0c6-c1ca-4b8e-add3-32926ef676c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.454408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0c0c6-c1ca-4b8e-add3-32926ef676c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.454686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0c0c6-c1ca-4b8e-add3-32926ef676c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.455487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0c0c6-c1ca-4b8e-add3-32926ef676c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.457024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0c0c6-c1ca-4b8e-add3-32926ef676c5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.468069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1017/2041] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:34.472008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0c0c6-c1ca-4b8e-add3-32926ef676c5 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.481906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0c0c6-c1ca-4b8e-add3-32926ef676c5 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.487757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57486c2d-e40b-49c6-869a-d1dd40b043c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.488518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486c2d-e40b-49c6-869a-d1dd40b043c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.488811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486c2d-e40b-49c6-869a-d1dd40b043c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.489081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486c2d-e40b-49c6-869a-d1dd40b043c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.489804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57486c2d-e40b-49c6-869a-d1dd40b043c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.491395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57486c2d-e40b-49c6-869a-d1dd40b043c2 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.503917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1018/2042] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:34.506822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57486c2d-e40b-49c6-869a-d1dd40b043c2 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.518881 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57486c2d-e40b-49c6-869a-d1dd40b043c2 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.525178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09584a19-38e0-4f91-9aa0-2cd37fa5dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.526261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09584a19-38e0-4f91-9aa0-2cd37fa5dc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.527279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09584a19-38e0-4f91-9aa0-2cd37fa5dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.527561 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09584a19-38e0-4f91-9aa0-2cd37fa5dc55 admin admin] PATH_INFO: `/v3/projects/e9ffa2d2a16f4f3498ede003a30ccb2f/users/1089c70ff3e942068c2b4ba97a850f99/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.544357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09584a19-38e0-4f91-9aa0-2cd37fa5dc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ffa2d2a16f4f3498ede003a30ccb2f, user_id=1089c70ff3e942068c2b4ba97a850f99, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.552432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09584a19-38e0-4f91-9aa0-2cd37fa5dc55 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.552580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1025/2043] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:34 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:34.553193 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de11747-6b94-4648-948f-96a7730f39dd admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.563273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de11747-6b94-4648-948f-96a7730f39dd admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.569122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a7756-11de-47ee-9703-2fc6ea1d836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.569795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a7756-11de-47ee-9703-2fc6ea1d836a admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.570086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a7756-11de-47ee-9703-2fc6ea1d836a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.570363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a7756-11de-47ee-9703-2fc6ea1d836a admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.571099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a7756-11de-47ee-9703-2fc6ea1d836a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.572993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a7756-11de-47ee-9703-2fc6ea1d836a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.583795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1026/2044] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:34.588029 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a7756-11de-47ee-9703-2fc6ea1d836a admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.599350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a7756-11de-47ee-9703-2fc6ea1d836a admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.604163 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f45e3d-d212-4d8d-9db9-0afa063c5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.604915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f45e3d-d212-4d8d-9db9-0afa063c5cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.605257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f45e3d-d212-4d8d-9db9-0afa063c5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.605574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f45e3d-d212-4d8d-9db9-0afa063c5cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.606369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f45e3d-d212-4d8d-9db9-0afa063c5cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.608088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f45e3d-d212-4d8d-9db9-0afa063c5cdf admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.621668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1027/2045] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:34.625789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f45e3d-d212-4d8d-9db9-0afa063c5cdf admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.635499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f45e3d-d212-4d8d-9db9-0afa063c5cdf admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.642204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd7236-3eaa-469f-b537-ca8e8f3265fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.643118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd7236-3eaa-469f-b537-ca8e8f3265fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.643361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd7236-3eaa-469f-b537-ca8e8f3265fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.643635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd7236-3eaa-469f-b537-ca8e8f3265fc admin admin] PATH_INFO: `/v3/projects/577025acc0f04b608d86fa64ba7bab97/users/bd7bd736772e43d7b1f1651b19f53855/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.658065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd7236-3eaa-469f-b537-ca8e8f3265fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=577025acc0f04b608d86fa64ba7bab97, user_id=bd7bd736772e43d7b1f1651b19f53855, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.660771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd7236-3eaa-469f-b537-ca8e8f3265fc admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.710607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1019/2046] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:34 2022] PUT /identity/v3/projects/e9ffa2d2a16f4f3498ede003a30ccb2f/users/1089c70ff3e942068c2b4ba97a850f99/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:34.720446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416e173-70ed-4e5e-a69a-a89cc159e310 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.720733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416e173-70ed-4e5e-a69a-a89cc159e310 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.721006 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416e173-70ed-4e5e-a69a-a89cc159e310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.746777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-e416e173-70ed-4e5e-a69a-a89cc159e310 None None] MFA Rules not processed for user `1089c70ff3e942068c2b4ba97a850f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:34.747997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e416e173-70ed-4e5e-a69a-a89cc159e310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:34.810503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1020/2047] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:34.822037 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1028/2048] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:34 2022] PUT /identity/v3/projects/577025acc0f04b608d86fa64ba7bab97/users/bd7bd736772e43d7b1f1651b19f53855/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:34.822169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416e173-70ed-4e5e-a69a-a89cc159e310 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.823295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e416e173-70ed-4e5e-a69a-a89cc159e310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:34.833672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7cba-21f8-411a-9175-6c0981c103a4 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.833958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7cba-21f8-411a-9175-6c0981c103a4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.834233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7cba-21f8-411a-9175-6c0981c103a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.862658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4cce7cba-21f8-411a-9175-6c0981c103a4 None None] MFA Rules not processed for user `bd7bd736772e43d7b1f1651b19f53855`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:34.863946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4cce7cba-21f8-411a-9175-6c0981c103a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:34.887380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416e173-70ed-4e5e-a69a-a89cc159e310 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.953673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c53abf-2e9b-48b3-8e65-2d09a19261ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.954536 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c53abf-2e9b-48b3-8e65-2d09a19261ec service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.954819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c53abf-2e9b-48b3-8e65-2d09a19261ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.955259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c53abf-2e9b-48b3-8e65-2d09a19261ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.961863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1029/2049] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:34.962812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce7cba-21f8-411a-9175-6c0981c103a4 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:35.034569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c53abf-2e9b-48b3-8e65-2d09a19261ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:35.040909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c53abf-2e9b-48b3-8e65-2d09a19261ec service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:35.046823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1021/2050] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:22:35.069873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce7cba-21f8-411a-9175-6c0981c103a4 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:35.081628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e1a63-e9b6-48a8-9b18-9584e63f2588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:35.082633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1a63-e9b6-48a8-9b18-9584e63f2588 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:35.083098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1a63-e9b6-48a8-9b18-9584e63f2588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:35.083666 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e1a63-e9b6-48a8-9b18-9584e63f2588 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:35.084931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e1a63-e9b6-48a8-9b18-9584e63f2588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:35.087556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e1a63-e9b6-48a8-9b18-9584e63f2588 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:35.207303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1030/2051] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:34 2022] POST /identity/v3/projects => generated 383 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:35.220176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c53abf-2e9b-48b3-8e65-2d09a19261ec service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:35.232577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c53abf-2e9b-48b3-8e65-2d09a19261ec service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:35.332688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a3403-b520-417e-b43d-ac01d84d82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:35.333771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a3403-b520-417e-b43d-ac01d84d82f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:35.333771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a3403-b520-417e-b43d-ac01d84d82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:35.333962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a3403-b520-417e-b43d-ac01d84d82f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:35.334637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a3403-b520-417e-b43d-ac01d84d82f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:35.337105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a3403-b520-417e-b43d-ac01d84d82f5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:35.465561 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1022/2052] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:35 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:35.466334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e1a63-e9b6-48a8-9b18-9584e63f2588 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:35.479279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e1a63-e9b6-48a8-9b18-9584e63f2588 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:35.486675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b466ae2-56ae-49bc-a999-3ccbdd0903bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:35.487388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b466ae2-56ae-49bc-a999-3ccbdd0903bf admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:35.487789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b466ae2-56ae-49bc-a999-3ccbdd0903bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:35.488684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b466ae2-56ae-49bc-a999-3ccbdd0903bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:35.490391 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b466ae2-56ae-49bc-a999-3ccbdd0903bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:35.493471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b466ae2-56ae-49bc-a999-3ccbdd0903bf admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:35.506542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1031/2053] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:35.511130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a3403-b520-417e-b43d-ac01d84d82f5 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:35.521483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a3403-b520-417e-b43d-ac01d84d82f5 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:35.530954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2ff2b-32d6-48ec-8eb3-209749793a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:35.530954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2ff2b-32d6-48ec-8eb3-209749793a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:35.530954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2ff2b-32d6-48ec-8eb3-209749793a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:35.530954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2ff2b-32d6-48ec-8eb3-209749793a18 admin admin] PATH_INFO: `/v3/projects/1f15f61baa894cb2bf5dcd08a7cd3233/users/b7bb123a7f9b4afdacde7e0ac4a1ae2b/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:35.548132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2ff2b-32d6-48ec-8eb3-209749793a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f15f61baa894cb2bf5dcd08a7cd3233, user_id=b7bb123a7f9b4afdacde7e0ac4a1ae2b, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:35.550791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2ff2b-32d6-48ec-8eb3-209749793a18 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:35.664419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1023/2054] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:35 2022] PUT /identity/v3/projects/1f15f61baa894cb2bf5dcd08a7cd3233/users/b7bb123a7f9b4afdacde7e0ac4a1ae2b/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:35.669980 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b466ae2-56ae-49bc-a999-3ccbdd0903bf admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:35.682360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b466ae2-56ae-49bc-a999-3ccbdd0903bf admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:35.748271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bd521-bb86-46b3-82eb-321609320882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:35.748949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bd521-bb86-46b3-82eb-321609320882 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:35.749233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bd521-bb86-46b3-82eb-321609320882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:35.749518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bd521-bb86-46b3-82eb-321609320882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:35.750256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bd521-bb86-46b3-82eb-321609320882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:35.751912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bd521-bb86-46b3-82eb-321609320882 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:35.762798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1032/2055] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:35.767063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2ff2b-32d6-48ec-8eb3-209749793a18 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:35.778435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2ff2b-32d6-48ec-8eb3-209749793a18 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:35.783508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c00c3-ac63-4606-bc73-652ddd7b1dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:35.784766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c00c3-ac63-4606-bc73-652ddd7b1dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:35.785051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c00c3-ac63-4606-bc73-652ddd7b1dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:35.785442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c00c3-ac63-4606-bc73-652ddd7b1dd2 admin admin] PATH_INFO: `/v3/projects/1f15f61baa894cb2bf5dcd08a7cd3233/users/b7bb123a7f9b4afdacde7e0ac4a1ae2b/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:35.788155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c00c3-ac63-4606-bc73-652ddd7b1dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f15f61baa894cb2bf5dcd08a7cd3233, user_id=b7bb123a7f9b4afdacde7e0ac4a1ae2b, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:35.791704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c00c3-ac63-4606-bc73-652ddd7b1dd2 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:35.802603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1024/2056] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:35 2022] PUT /identity/v3/projects/1f15f61baa894cb2bf5dcd08a7cd3233/users/b7bb123a7f9b4afdacde7e0ac4a1ae2b/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:35.813528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742cd76-7982-4157-906a-ad29e7086278 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:35.813839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742cd76-7982-4157-906a-ad29e7086278 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:35.814111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742cd76-7982-4157-906a-ad29e7086278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:35.844609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4742cd76-7982-4157-906a-ad29e7086278 None None] MFA Rules not processed for user `b7bb123a7f9b4afdacde7e0ac4a1ae2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:35.845839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4742cd76-7982-4157-906a-ad29e7086278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:35.871727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:35.917101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1033/2057] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:35.928121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c00c3-ac63-4606-bc73-652ddd7b1dd2 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:35.929893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b64c00c3-ac63-4606-bc73-652ddd7b1dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:35.996985 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c00c3-ac63-4606-bc73-652ddd7b1dd2 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:36.000801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398499f-be25-4d81-b7b1-19f1615adfb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:36.001361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398499f-be25-4d81-b7b1-19f1615adfb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:36.001646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398499f-be25-4d81-b7b1-19f1615adfb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:36.001944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398499f-be25-4d81-b7b1-19f1615adfb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:36.067574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398499f-be25-4d81-b7b1-19f1615adfb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:36.069055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398499f-be25-4d81-b7b1-19f1615adfb8 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:36.079281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1025/2058] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:36.819596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:38.610248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:39.334222 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:39.642068 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:40.487261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:40.642041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:40.782258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:43.375394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba8c3a-88ed-413b-b42a-693d0b459f92 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:43.376167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba8c3a-88ed-413b-b42a-693d0b459f92 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:43.376167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba8c3a-88ed-413b-b42a-693d0b459f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:43.395304 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-c9ba8c3a-88ed-413b-b42a-693d0b459f92 None None] MFA Rules not processed for user `5c3f539d6d374fd8b3eaa9e3e22e5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:43.396560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c9ba8c3a-88ed-413b-b42a-693d0b459f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:43.439867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:43.454762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1034/2059] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:49.956490 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398499f-be25-4d81-b7b1-19f1615adfb8 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:49.961392 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a398499f-be25-4d81-b7b1-19f1615adfb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.057201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398499f-be25-4d81-b7b1-19f1615adfb8 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:50.064312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:50.065202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.065482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.065755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] PATH_INFO: `/v3/users/2009db58af5541b7b8dc813076122e9f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.066994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2009db58af5541b7b8dc813076122e9f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:50.069141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:50.180677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5c120-fe3f-4026-9ef8-efccb3d7ac49 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.180677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5c120-fe3f-4026-9ef8-efccb3d7ac49 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.180677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5c120-fe3f-4026-9ef8-efccb3d7ac49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.228795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-5af5c120-fe3f-4026-9ef8-efccb3d7ac49 None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:50.228795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5af5c120-fe3f-4026-9ef8-efccb3d7ac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.308092 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2009db58af5541b7b8dc813076122e9f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:50.314276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1035/2060] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:22:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:50.373677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5c120-fe3f-4026-9ef8-efccb3d7ac49 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:50.375163 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5af5c120-fe3f-4026-9ef8-efccb3d7ac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.395572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2009db58af5541b7b8dc813076122e9f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:50.425408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2009db58af5541b7b8dc813076122e9f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:50.426181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2009db58af5541b7b8dc813076122e9f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:50.434566 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3dd6befb-fb3e-4656-a626-f0ef8fa58e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2009db58af5541b7b8dc813076122e9f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:50.444758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1026/2061] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:49 2022] DELETE /identity/v3/users/2009db58af5541b7b8dc813076122e9f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:50.451304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523f05-35fa-4a6c-8ddb-6a13c0d20435 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.452280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523f05-35fa-4a6c-8ddb-6a13c0d20435 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.452565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523f05-35fa-4a6c-8ddb-6a13c0d20435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.472083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9c523f05-35fa-4a6c-8ddb-6a13c0d20435 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:50.473632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9c523f05-35fa-4a6c-8ddb-6a13c0d20435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.503501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5c120-fe3f-4026-9ef8-efccb3d7ac49 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:50.568268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1027/2062] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:50.577657 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523f05-35fa-4a6c-8ddb-6a13c0d20435 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:50.579313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9c523f05-35fa-4a6c-8ddb-6a13c0d20435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.600587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe025-cd0c-4910-8dad-618302a88dd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:50.600722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:50.601336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe025-cd0c-4910-8dad-618302a88dd6 service swift] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.601556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe025-cd0c-4910-8dad-618302a88dd6 service swift] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.601833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe025-cd0c-4910-8dad-618302a88dd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.604175 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9e8fe025-cd0c-4910-8dad-618302a88dd6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.645322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:50.697862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523f05-35fa-4a6c-8ddb-6a13c0d20435 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:50.703632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeecb6-1565-48f8-b8d5-b086d4ecd356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:50.704487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeecb6-1565-48f8-b8d5-b086d4ecd356 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.704915 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeecb6-1565-48f8-b8d5-b086d4ecd356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.705196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeecb6-1565-48f8-b8d5-b086d4ecd356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.706471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fe025-cd0c-4910-8dad-618302a88dd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:50.709133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fe025-cd0c-4910-8dad-618302a88dd6 service swift] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:50.720214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaeecb6-1565-48f8-b8d5-b086d4ecd356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:50.720705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1036/2063] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:22:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:22:50.721678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe025-cd0c-4910-8dad-618302a88dd6 service swift] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:50.723100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9e8fe025-cd0c-4910-8dad-618302a88dd6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.728610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaeecb6-1565-48f8-b8d5-b086d4ecd356 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:50.737478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe025-cd0c-4910-8dad-618302a88dd6 service swift] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:50.742977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:50.744241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.744625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.745014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] PATH_INFO: `/v3/users/1089c70ff3e942068c2b4ba97a850f99` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.747034 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1089c70ff3e942068c2b4ba97a850f99)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:50.749895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:50.755988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1028/2064] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:22:50.757913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeecb6-1565-48f8-b8d5-b086d4ecd356 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:50.759994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cdaeecb6-1565-48f8-b8d5-b086d4ecd356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.885811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeecb6-1565-48f8-b8d5-b086d4ecd356 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:50.895336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dfe52-7324-40dc-aab7-0d56f3a5fdcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:50.896807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dfe52-7324-40dc-aab7-0d56f3a5fdcc service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.896807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dfe52-7324-40dc-aab7-0d56f3a5fdcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.896807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dfe52-7324-40dc-aab7-0d56f3a5fdcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.898478 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bb9dfe52-7324-40dc-aab7-0d56f3a5fdcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.980015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dfe52-7324-40dc-aab7-0d56f3a5fdcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:50.982381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dfe52-7324-40dc-aab7-0d56f3a5fdcc service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:50.992008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1029/2065] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:51.031022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1089c70ff3e942068c2b4ba97a850f99'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:51.126135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1089c70ff3e942068c2b4ba97a850f99'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:51.155270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1089c70ff3e942068c2b4ba97a850f99'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:51.156448 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1089c70ff3e942068c2b4ba97a850f99'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:51.181203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1089c70ff3e942068c2b4ba97a850f99'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:51.191195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1037/2066] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:50 2022] DELETE /identity/v3/users/1089c70ff3e942068c2b4ba97a850f99 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:51.195965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9548f-50c9-4042-88fd-c77f6ff4d101 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:51.196259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9548f-50c9-4042-88fd-c77f6ff4d101 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:51.196552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9548f-50c9-4042-88fd-c77f6ff4d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.228094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d1b9548f-50c9-4042-88fd-c77f6ff4d101 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:51.229366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d1b9548f-50c9-4042-88fd-c77f6ff4d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:51.265755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:51.297840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1030/2067] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:51.308116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:51.310254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:51.348393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9548f-50c9-4042-88fd-c77f6ff4d101 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:51.351556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d1b9548f-50c9-4042-88fd-c77f6ff4d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:51.382425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9548f-50c9-4042-88fd-c77f6ff4d101 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:51.389715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:51.391390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:51.397732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:51.406237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] PATH_INFO: `/v3/projects/8df41c0b3dd24a30a1f72ad7e95191ba` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.406237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df41c0b3dd24a30a1f72ad7e95191ba)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:51.406237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:51.452119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f7c72-4886-4577-ba37-c5cc8ba24899 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:51.470684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43132a-7558-4334-b6a1-1134f0256ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:51.472689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43132a-7558-4334-b6a1-1134f0256ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:51.473223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43132a-7558-4334-b6a1-1134f0256ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:51.473558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43132a-7558-4334-b6a1-1134f0256ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.487224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43132a-7558-4334-b6a1-1134f0256ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:51.488736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43132a-7558-4334-b6a1-1134f0256ea9 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:51.504088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1038/2068] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:51.581457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df41c0b3dd24a30a1f72ad7e95191ba', 'request_id': 'req-fed29af1-bb94-4490-bf41-f7ca93958c6c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:51.594277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df41c0b3dd24a30a1f72ad7e95191ba', 'request_id': 'req-fed29af1-bb94-4490-bf41-f7ca93958c6c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:51.670339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df41c0b3dd24a30a1f72ad7e95191ba', 'request_id': 'req-fed29af1-bb94-4490-bf41-f7ca93958c6c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:51.683291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] The token cache is being invalidate because project 8df41c0b3dd24a30a1f72ad7e95191ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:51.683589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:51.684970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fed29af1-bb94-4490-bf41-f7ca93958c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:51.686535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1031/2069] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:51 2022] DELETE /identity/v3/projects/8df41c0b3dd24a30a1f72ad7e95191ba => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:51.690714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43132a-7558-4334-b6a1-1134f0256ea9 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:51.701922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43132a-7558-4334-b6a1-1134f0256ea9 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:51.740484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:51.782906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:51.783811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:51.784276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:51.784668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] PATH_INFO: `/v3/users/e6c218b4bfc04b5db1d37f085596a1e9` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.786028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c218b4bfc04b5db1d37f085596a1e9)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:51.790947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:51.933446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05836-e417-45d8-b890-db1c715eaeda None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:51.933545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05836-e417-45d8-b890-db1c715eaeda None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:51.933829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05836-e417-45d8-b890-db1c715eaeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.956750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-1ca05836-e417-45d8-b890-db1c715eaeda None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:51.957987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1ca05836-e417-45d8-b890-db1c715eaeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:52.021496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1032/2070] 10.222.0.46 () {58 vars in 967 bytes} [Thu Jun 2 13:22:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:52.036033 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05836-e417-45d8-b890-db1c715eaeda None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.037168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1ca05836-e417-45d8-b890-db1c715eaeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:52.045223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c218b4bfc04b5db1d37f085596a1e9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.110927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c218b4bfc04b5db1d37f085596a1e9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.125892 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c218b4bfc04b5db1d37f085596a1e9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.126778 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c218b4bfc04b5db1d37f085596a1e9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.135244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c218b4bfc04b5db1d37f085596a1e9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.144485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1039/2071] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:51 2022] DELETE /identity/v3/users/e6c218b4bfc04b5db1d37f085596a1e9 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:52.148690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05836-e417-45d8-b890-db1c715eaeda None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:52.148822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.151175 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:52.160518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:52.233168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae6f76-242c-43b2-bf84-b5055b108288 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.233843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae6f76-242c-43b2-bf84-b5055b108288 service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.234069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae6f76-242c-43b2-bf84-b5055b108288 service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.234330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae6f76-242c-43b2-bf84-b5055b108288 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.241279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0aae6f76-242c-43b2-bf84-b5055b108288 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:52.269771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faa786-0ce1-4f43-bef2-30ac8b17963b admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:52.275535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.276632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.276933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.277197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] PATH_INFO: `/v3/projects/e9ffa2d2a16f4f3498ede003a30ccb2f` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.279036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ffa2d2a16f4f3498ede003a30ccb2f)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.281067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:52.313414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae6f76-242c-43b2-bf84-b5055b108288 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.315240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae6f76-242c-43b2-bf84-b5055b108288 service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:52.327977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1033/2072] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:22:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:22:52.410543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ffa2d2a16f4f3498ede003a30ccb2f', 'request_id': 'req-a822cade-e5f4-4683-a976-d269156b7399'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.421393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ffa2d2a16f4f3498ede003a30ccb2f', 'request_id': 'req-a822cade-e5f4-4683-a976-d269156b7399'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.556746 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ffa2d2a16f4f3498ede003a30ccb2f', 'request_id': 'req-a822cade-e5f4-4683-a976-d269156b7399'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.569626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] The token cache is being invalidate because project e9ffa2d2a16f4f3498ede003a30ccb2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:52.570003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.570756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a822cade-e5f4-4683-a976-d269156b7399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.572590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1040/2073] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:52 2022] DELETE /identity/v3/projects/e9ffa2d2a16f4f3498ede003a30ccb2f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:52.578060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3ef5-def7-4f80-9e4c-7b889c441dd0 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.578449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3ef5-def7-4f80-9e4c-7b889c441dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.578670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a3ef5-def7-4f80-9e4c-7b889c441dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.600743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c42a3ef5-def7-4f80-9e4c-7b889c441dd0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:52.602062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c42a3ef5-def7-4f80-9e4c-7b889c441dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:52.685098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1034/2074] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:52.686891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63e7a3-45ba-4e29-b39c-50072b58d038 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.687177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63e7a3-45ba-4e29-b39c-50072b58d038 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.687453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63e7a3-45ba-4e29-b39c-50072b58d038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.706902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-5d63e7a3-45ba-4e29-b39c-50072b58d038 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:52.711070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5d63e7a3-45ba-4e29-b39c-50072b58d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:52.717737 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1041/2075] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:52.722199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3ef5-def7-4f80-9e4c-7b889c441dd0 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.728480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:52.744042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63e7a3-45ba-4e29-b39c-50072b58d038 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.744225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a3ef5-def7-4f80-9e4c-7b889c441dd0 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:52.745958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5d63e7a3-45ba-4e29-b39c-50072b58d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:52.749556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7390-c354-45a1-86bf-de49c549e338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.750673 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7390-c354-45a1-86bf-de49c549e338 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.750958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7390-c354-45a1-86bf-de49c549e338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.751236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7390-c354-45a1-86bf-de49c549e338 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.752030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e7390-c354-45a1-86bf-de49c549e338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:52.752736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e7390-c354-45a1-86bf-de49c549e338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.754367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e7390-c354-45a1-86bf-de49c549e338 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:52.767997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63e7a3-45ba-4e29-b39c-50072b58d038 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:52.773543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.774449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.774710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.774986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] PATH_INFO: `/v3/projects/a6aab1f1786744219e36a71211c25478` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.776415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6aab1f1786744219e36a71211c25478)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.777196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1035/2076] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:52.779100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:52.782560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7390-c354-45a1-86bf-de49c549e338 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.799916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7390-c354-45a1-86bf-de49c549e338 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:52.806249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6e0b8-fc4f-4c18-9a54-cc415bee3de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.806995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6e0b8-fc4f-4c18-9a54-cc415bee3de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.807294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6e0b8-fc4f-4c18-9a54-cc415bee3de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.807576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6e0b8-fc4f-4c18-9a54-cc415bee3de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.808380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6e0b8-fc4f-4c18-9a54-cc415bee3de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.810422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6e0b8-fc4f-4c18-9a54-cc415bee3de6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:52.910365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1036/2077] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:52 2022] POST /identity/v3/projects => generated 361 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:52.919198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6e0b8-fc4f-4c18-9a54-cc415bee3de6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.922044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6aab1f1786744219e36a71211c25478', 'request_id': 'req-996bdea6-075e-49a5-a565-3346edcbe6a4'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.928436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6aab1f1786744219e36a71211c25478', 'request_id': 'req-996bdea6-075e-49a5-a565-3346edcbe6a4'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:52.986158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6e0b8-fc4f-4c18-9a54-cc415bee3de6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:52.994316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf67cc-0b4e-43e8-8c71-adafd6b62b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.995000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf67cc-0b4e-43e8-8c71-adafd6b62b4f admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.995285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf67cc-0b4e-43e8-8c71-adafd6b62b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.995559 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf67cc-0b4e-43e8-8c71-adafd6b62b4f admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.996337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf67cc-0b4e-43e8-8c71-adafd6b62b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.998246 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf67cc-0b4e-43e8-8c71-adafd6b62b4f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.053860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6aab1f1786744219e36a71211c25478', 'request_id': 'req-996bdea6-075e-49a5-a565-3346edcbe6a4'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:53.065535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] The token cache is being invalidate because project a6aab1f1786744219e36a71211c25478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:53.065815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:53.067306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-996bdea6-075e-49a5-a565-3346edcbe6a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:53.068077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1042/2078] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:52 2022] DELETE /identity/v3/projects/a6aab1f1786744219e36a71211c25478 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:53.072712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3d4f3-1738-4604-8963-f7ce21a2fba9 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.073004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3d4f3-1738-4604-8963-f7ce21a2fba9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.073283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3d4f3-1738-4604-8963-f7ce21a2fba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.094344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f5a3d4f3-1738-4604-8963-f7ce21a2fba9 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:53.095558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f5a3d4f3-1738-4604-8963-f7ce21a2fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:53.103551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1043/2079] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:53.111135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbebdef-0b4e-45aa-a054-1fdb5dae7642 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.111802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbebdef-0b4e-45aa-a054-1fdb5dae7642 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.111802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbebdef-0b4e-45aa-a054-1fdb5dae7642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.120613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1037/2080] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:52 2022] POST /identity/v3/users => generated 281 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:53.121790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf67cc-0b4e-43e8-8c71-adafd6b62b4f admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.123580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7cdf67cc-0b4e-43e8-8c71-adafd6b62b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:53.130602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ddbebdef-0b4e-45aa-a054-1fdb5dae7642 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:53.131801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ddbebdef-0b4e-45aa-a054-1fdb5dae7642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:53.136468 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf67cc-0b4e-43e8-8c71-adafd6b62b4f admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.140388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1044/2081] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:53.144952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbebdef-0b4e-45aa-a054-1fdb5dae7642 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.147568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dc1e2-5a42-4886-b2a0-97a2f129191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.147568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dc1e2-5a42-4886-b2a0-97a2f129191c admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.147568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dc1e2-5a42-4886-b2a0-97a2f129191c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.147568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dc1e2-5a42-4886-b2a0-97a2f129191c admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.147956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dc1e2-5a42-4886-b2a0-97a2f129191c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.149370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dc1e2-5a42-4886-b2a0-97a2f129191c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.162090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbebdef-0b4e-45aa-a054-1fdb5dae7642 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.167483 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becaf82-85af-4573-bfb8-19d0467cbd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.168191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becaf82-85af-4573-bfb8-19d0467cbd35 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.170657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becaf82-85af-4573-bfb8-19d0467cbd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.170657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becaf82-85af-4573-bfb8-19d0467cbd35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.170946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1038/2082] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:53.171661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dc1e2-5a42-4886-b2a0-97a2f129191c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.172851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becaf82-85af-4573-bfb8-19d0467cbd35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:53.173204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becaf82-85af-4573-bfb8-19d0467cbd35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.174880 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becaf82-85af-4573-bfb8-19d0467cbd35 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.186007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dc1e2-5a42-4886-b2a0-97a2f129191c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.190997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1045/2083] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:53.191789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11236df0-d2ff-4aa7-9d98-69cd3711a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.192640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8478c59-aa93-475e-9988-b8d8b64132cb None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.192853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11236df0-d2ff-4aa7-9d98-69cd3711a9ec admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.192965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8478c59-aa93-475e-9988-b8d8b64132cb None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.193219 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8478c59-aa93-475e-9988-b8d8b64132cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.193533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11236df0-d2ff-4aa7-9d98-69cd3711a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.193954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11236df0-d2ff-4aa7-9d98-69cd3711a9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.194984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11236df0-d2ff-4aa7-9d98-69cd3711a9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.196900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11236df0-d2ff-4aa7-9d98-69cd3711a9ec admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.216869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1039/2084] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:53.216869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11236df0-d2ff-4aa7-9d98-69cd3711a9ec admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.221595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-c8478c59-aa93-475e-9988-b8d8b64132cb None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:53.222854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c8478c59-aa93-475e-9988-b8d8b64132cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:53.226022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11236df0-d2ff-4aa7-9d98-69cd3711a9ec admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.233915 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd657eb-d744-4c50-be9a-b7b674bd4270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.234921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd657eb-d744-4c50-be9a-b7b674bd4270 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.235357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd657eb-d744-4c50-be9a-b7b674bd4270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.235797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd657eb-d744-4c50-be9a-b7b674bd4270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.236953 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd657eb-d744-4c50-be9a-b7b674bd4270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.239134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd657eb-d744-4c50-be9a-b7b674bd4270 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.281012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1046/2085] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:53.281774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8478c59-aa93-475e-9988-b8d8b64132cb None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.293189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8478c59-aa93-475e-9988-b8d8b64132cb None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.297852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d40b00-59f4-4bb4-8bd4-7ec313b883c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.298755 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d40b00-59f4-4bb4-8bd4-7ec313b883c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.299036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d40b00-59f4-4bb4-8bd4-7ec313b883c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.299307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d40b00-59f4-4bb4-8bd4-7ec313b883c9 admin admin] PATH_INFO: `/v3/projects/941aca67ed1c4eeaa9d9b005d1c8109f/users/23e96376f3fa4bea9f0179ddd502789e/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.314224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d40b00-59f4-4bb4-8bd4-7ec313b883c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941aca67ed1c4eeaa9d9b005d1c8109f, user_id=23e96376f3fa4bea9f0179ddd502789e, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.316955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d40b00-59f4-4bb4-8bd4-7ec313b883c9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.450757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1040/2086] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:53 2022] POST /identity/v3/projects => generated 365 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:53.451934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd657eb-d744-4c50-be9a-b7b674bd4270 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.453542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3cd657eb-d744-4c50-be9a-b7b674bd4270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:53.472308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1047/2087] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:53 2022] PUT /identity/v3/projects/941aca67ed1c4eeaa9d9b005d1c8109f/users/23e96376f3fa4bea9f0179ddd502789e/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:53.473397 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d40b00-59f4-4bb4-8bd4-7ec313b883c9 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.532686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd657eb-d744-4c50-be9a-b7b674bd4270 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.554120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d40b00-59f4-4bb4-8bd4-7ec313b883c9 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.566656 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db90d9c-d784-4a07-9b9b-36197db45cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.567370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db90d9c-d784-4a07-9b9b-36197db45cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.567666 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db90d9c-d784-4a07-9b9b-36197db45cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.567984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db90d9c-d784-4a07-9b9b-36197db45cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.568695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db90d9c-d784-4a07-9b9b-36197db45cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.570727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db90d9c-d784-4a07-9b9b-36197db45cc1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.601778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5e5a1-2d56-4844-8bb7-3276d39a3209 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.602432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e5a1-2d56-4844-8bb7-3276d39a3209 service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.602752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e5a1-2d56-4844-8bb7-3276d39a3209 service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.603025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e5a1-2d56-4844-8bb7-3276d39a3209 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.648155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:53.659445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1048/2088] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:53 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:53.660714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c61c7e-75f6-4bf4-87b4-8eb3a2289608 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.661005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c61c7e-75f6-4bf4-87b4-8eb3a2289608 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.661285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c61c7e-75f6-4bf4-87b4-8eb3a2289608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.667179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5e5a1-2d56-4844-8bb7-3276d39a3209 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.668887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5e5a1-2d56-4844-8bb7-3276d39a3209 service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.682291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1041/2089] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:22:53.683240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5e5a1-2d56-4844-8bb7-3276d39a3209 service swift] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.694715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5e5a1-2d56-4844-8bb7-3276d39a3209 service swift] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.696376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-48c61c7e-75f6-4bf4-87b4-8eb3a2289608 None None] MFA Rules not processed for user `23e96376f3fa4bea9f0179ddd502789e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:53.698986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-48c61c7e-75f6-4bf4-87b4-8eb3a2289608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:53.700512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b3b24-3f7a-41cf-ba7e-89480806ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.701753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b3b24-3f7a-41cf-ba7e-89480806ac8d admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.702248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b3b24-3f7a-41cf-ba7e-89480806ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.702476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b3b24-3f7a-41cf-ba7e-89480806ac8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.703244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b3b24-3f7a-41cf-ba7e-89480806ac8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.704909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b3b24-3f7a-41cf-ba7e-89480806ac8d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.721882 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1042/2090] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:53.725982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b3b24-3f7a-41cf-ba7e-89480806ac8d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.738154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b3b24-3f7a-41cf-ba7e-89480806ac8d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.743050 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea0bf8-7661-471d-89ff-c2dc685cde37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.743959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0bf8-7661-471d-89ff-c2dc685cde37 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.744248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0bf8-7661-471d-89ff-c2dc685cde37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.748076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0bf8-7661-471d-89ff-c2dc685cde37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.748076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea0bf8-7661-471d-89ff-c2dc685cde37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.748076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea0bf8-7661-471d-89ff-c2dc685cde37 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.759663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1043/2091] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:53.765124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea0bf8-7661-471d-89ff-c2dc685cde37 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.775800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea0bf8-7661-471d-89ff-c2dc685cde37 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.779604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1049/2092] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:53.786999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1106e-0d5b-44a3-842e-af7f41de8df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.786999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1106e-0d5b-44a3-842e-af7f41de8df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.786999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1106e-0d5b-44a3-842e-af7f41de8df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.786999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1106e-0d5b-44a3-842e-af7f41de8df5 admin admin] PATH_INFO: `/v3/projects/884590b0bda54b2dad9712880a3b9588/users/1104f255363741209bbcbb2584a3c491/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.814049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1106e-0d5b-44a3-842e-af7f41de8df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884590b0bda54b2dad9712880a3b9588, user_id=1104f255363741209bbcbb2584a3c491, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.820049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c61c7e-75f6-4bf4-87b4-8eb3a2289608 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.820247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1106e-0d5b-44a3-842e-af7f41de8df5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.821495 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-48c61c7e-75f6-4bf4-87b4-8eb3a2289608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:53.861886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:53.893398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1044/2093] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:53 2022] PUT /identity/v3/projects/884590b0bda54b2dad9712880a3b9588/users/1104f255363741209bbcbb2584a3c491/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:53.901689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c61c7e-75f6-4bf4-87b4-8eb3a2289608 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.912973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb37e6-6ddc-46c1-b85a-dae68dc3dda6 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.913341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb37e6-6ddc-46c1-b85a-dae68dc3dda6 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.913754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb37e6-6ddc-46c1-b85a-dae68dc3dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.953004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-54bb37e6-6ddc-46c1-b85a-dae68dc3dda6 None None] MFA Rules not processed for user `1104f255363741209bbcbb2584a3c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:53.955442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-54bb37e6-6ddc-46c1-b85a-dae68dc3dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:53.989894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6c629-d035-42c2-9aaa-2960277770e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.990568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6c629-d035-42c2-9aaa-2960277770e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.991288 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6c629-d035-42c2-9aaa-2960277770e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.991629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6c629-d035-42c2-9aaa-2960277770e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.022934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.094995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6c629-d035-42c2-9aaa-2960277770e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.097134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6c629-d035-42c2-9aaa-2960277770e5 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.097901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1045/2094] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:54.102152 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb37e6-6ddc-46c1-b85a-dae68dc3dda6 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.120815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1050/2095] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:22:54.144673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6c629-d035-42c2-9aaa-2960277770e5 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.257278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.259502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6c629-d035-42c2-9aaa-2960277770e5 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.265641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.266479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.266761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.267138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] PATH_INFO: `/v3/users/23e96376f3fa4bea9f0179ddd502789e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.268704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e96376f3fa4bea9f0179ddd502789e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.269010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb37e6-6ddc-46c1-b85a-dae68dc3dda6 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.270687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.293834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab474d67-467d-491b-898e-0318ebf8ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.294825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab474d67-467d-491b-898e-0318ebf8ceed admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.295267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab474d67-467d-491b-898e-0318ebf8ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.295694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab474d67-467d-491b-898e-0318ebf8ceed admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.296591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab474d67-467d-491b-898e-0318ebf8ceed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.299227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab474d67-467d-491b-898e-0318ebf8ceed admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.416922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.423390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1046/2096] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:54 2022] POST /identity/v3/projects => generated 363 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:54.427560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab474d67-467d-491b-898e-0318ebf8ceed admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.490478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e96376f3fa4bea9f0179ddd502789e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:54.528083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab474d67-467d-491b-898e-0318ebf8ceed admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.537930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e5517-bafb-40aa-b586-b240a6bd6c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.538172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e5517-bafb-40aa-b586-b240a6bd6c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.538492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e5517-bafb-40aa-b586-b240a6bd6c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.538715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e5517-bafb-40aa-b586-b240a6bd6c56 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.539443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e5517-bafb-40aa-b586-b240a6bd6c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.541433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e5517-bafb-40aa-b586-b240a6bd6c56 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.567250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e96376f3fa4bea9f0179ddd502789e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:54.596280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e96376f3fa4bea9f0179ddd502789e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:54.596280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e96376f3fa4bea9f0179ddd502789e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:54.603849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-db59a18e-55fd-41e9-927e-ca86f14bd44e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e96376f3fa4bea9f0179ddd502789e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:54.615952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1051/2097] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:54 2022] DELETE /identity/v3/users/23e96376f3fa4bea9f0179ddd502789e => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:54.623996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de15e60-85d2-427f-91d8-5bd60cad499b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.623996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de15e60-85d2-427f-91d8-5bd60cad499b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.623996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de15e60-85d2-427f-91d8-5bd60cad499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.640837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-2de15e60-85d2-427f-91d8-5bd60cad499b None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:54.642060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2de15e60-85d2-427f-91d8-5bd60cad499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:54.676003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1047/2098] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:54 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:54.676542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2127-7d1a-4ddc-88d4-96f1ba148cf7 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.676844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2127-7d1a-4ddc-88d4-96f1ba148cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.677128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2127-7d1a-4ddc-88d4-96f1ba148cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.696447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-ebdd2127-7d1a-4ddc-88d4-96f1ba148cf7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:54.697675 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ebdd2127-7d1a-4ddc-88d4-96f1ba148cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:54.709643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1052/2099] 10.222.0.46 () {58 vars in 967 bytes} [Thu Jun 2 13:22:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:54.710598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de15e60-85d2-427f-91d8-5bd60cad499b None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.712499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2de15e60-85d2-427f-91d8-5bd60cad499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:54.781036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1048/2100] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:54.784527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2127-7d1a-4ddc-88d4-96f1ba148cf7 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.794266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ebdd2127-7d1a-4ddc-88d4-96f1ba148cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:54.821177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de15e60-85d2-427f-91d8-5bd60cad499b None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.834140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ee103-2839-4c19-9ed3-d9f591698e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.834942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee103-2839-4c19-9ed3-d9f591698e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.840053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee103-2839-4c19-9ed3-d9f591698e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.840053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee103-2839-4c19-9ed3-d9f591698e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.840053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ee103-2839-4c19-9ed3-d9f591698e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.840053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ee103-2839-4c19-9ed3-d9f591698e17 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.849742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1053/2101] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:54.850726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ee103-2839-4c19-9ed3-d9f591698e17 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.854885 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0f7ee103-2839-4c19-9ed3-d9f591698e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:54.887318 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2127-7d1a-4ddc-88d4-96f1ba148cf7 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.894150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640f80-3b7a-4e3e-a967-42db97acb34e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.894863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640f80-3b7a-4e3e-a967-42db97acb34e service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.895147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640f80-3b7a-4e3e-a967-42db97acb34e service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.895425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640f80-3b7a-4e3e-a967-42db97acb34e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.902051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.905182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8640f80-3b7a-4e3e-a967-42db97acb34e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.906938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8640f80-3b7a-4e3e-a967-42db97acb34e service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.915601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1049/2102] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:22:54.916567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640f80-3b7a-4e3e-a967-42db97acb34e service swift] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.925868 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ee103-2839-4c19-9ed3-d9f591698e17 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.931035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5ac1b-f532-4ebf-955e-3a6a3ba265f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.931709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5ac1b-f532-4ebf-955e-3a6a3ba265f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.932023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5ac1b-f532-4ebf-955e-3a6a3ba265f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.932332 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5ac1b-f532-4ebf-955e-3a6a3ba265f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.932943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640f80-3b7a-4e3e-a967-42db97acb34e service swift] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.937989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41397c30-7f1f-46ed-8065-99d80de9300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.938964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41397c30-7f1f-46ed-8065-99d80de9300d admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.939291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41397c30-7f1f-46ed-8065-99d80de9300d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.939614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41397c30-7f1f-46ed-8065-99d80de9300d admin admin] PATH_INFO: `/v3/projects/aa0efb82008749e69d6a583ce1bab570/users/1c16242c9b244a3eb95d16d72b7aaa2e/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.951015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5ac1b-f532-4ebf-955e-3a6a3ba265f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.952586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.954733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5ac1b-f532-4ebf-955e-3a6a3ba265f1 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.960635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41397c30-7f1f-46ed-8065-99d80de9300d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0efb82008749e69d6a583ce1bab570, user_id=1c16242c9b244a3eb95d16d72b7aaa2e, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.960635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41397c30-7f1f-46ed-8065-99d80de9300d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.966985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1054/2103] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:55.071642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1050/2104] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:54 2022] PUT /identity/v3/projects/aa0efb82008749e69d6a583ce1bab570/users/1c16242c9b244a3eb95d16d72b7aaa2e/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:55.076119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5ac1b-f532-4ebf-955e-3a6a3ba265f1 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.087909 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5ac1b-f532-4ebf-955e-3a6a3ba265f1 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.163191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5cb78-d729-48ec-8145-89bebbe129fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.163786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5cb78-d729-48ec-8145-89bebbe129fc admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.164115 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5cb78-d729-48ec-8145-89bebbe129fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.164390 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5cb78-d729-48ec-8145-89bebbe129fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.165132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5cb78-d729-48ec-8145-89bebbe129fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:55.166905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5cb78-d729-48ec-8145-89bebbe129fc admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.178396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1055/2105] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:55.182687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41397c30-7f1f-46ed-8065-99d80de9300d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.194568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41397c30-7f1f-46ed-8065-99d80de9300d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.200231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c6bb3-4877-4503-98fe-207f9358a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.200969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c6bb3-4877-4503-98fe-207f9358a8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.201254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c6bb3-4877-4503-98fe-207f9358a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.201545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c6bb3-4877-4503-98fe-207f9358a8a2 admin admin] PATH_INFO: `/v3/projects/aa0efb82008749e69d6a583ce1bab570/users/1c16242c9b244a3eb95d16d72b7aaa2e/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.203576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c6bb3-4877-4503-98fe-207f9358a8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0efb82008749e69d6a583ce1bab570, user_id=1c16242c9b244a3eb95d16d72b7aaa2e, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:55.206687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c6bb3-4877-4503-98fe-207f9358a8a2 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.220253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1051/2106] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:55 2022] PUT /identity/v3/projects/aa0efb82008749e69d6a583ce1bab570/users/1c16242c9b244a3eb95d16d72b7aaa2e/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:55.231521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08038398-7a2a-4276-94ca-d04c0b3840c9 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.232369 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08038398-7a2a-4276-94ca-d04c0b3840c9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.232715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08038398-7a2a-4276-94ca-d04c0b3840c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.260453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-08038398-7a2a-4276-94ca-d04c0b3840c9 None None] MFA Rules not processed for user `1c16242c9b244a3eb95d16d72b7aaa2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:55.261708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-08038398-7a2a-4276-94ca-d04c0b3840c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:55.364996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1056/2107] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:55.371628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c6bb3-4877-4503-98fe-207f9358a8a2 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.374170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1f2c6bb3-4877-4503-98fe-207f9358a8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:55.467920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c6bb3-4877-4503-98fe-207f9358a8a2 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.472800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed09c-9fe6-43a0-8c32-aa7e473c925b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.473523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed09c-9fe6-43a0-8c32-aa7e473c925b service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.473813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed09c-9fe6-43a0-8c32-aa7e473c925b service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.474256 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed09c-9fe6-43a0-8c32-aa7e473c925b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.488936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed09c-9fe6-43a0-8c32-aa7e473c925b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:55.490419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed09c-9fe6-43a0-8c32-aa7e473c925b service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.501348 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1052/2108] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:22:55.530476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08038398-7a2a-4276-94ca-d04c0b3840c9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.532336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-08038398-7a2a-4276-94ca-d04c0b3840c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:55.620908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08038398-7a2a-4276-94ca-d04c0b3840c9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.632279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.633484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.633943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.634315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] PATH_INFO: `/v3/projects/941aca67ed1c4eeaa9d9b005d1c8109f` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.635984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=941aca67ed1c4eeaa9d9b005d1c8109f)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:55.639268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.689262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed09c-9fe6-43a0-8c32-aa7e473c925b service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.690687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c32ed09c-9fe6-43a0-8c32-aa7e473c925b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:55.706264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed09c-9fe6-43a0-8c32-aa7e473c925b service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.712275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cde0ef-b7f4-4f7c-b23e-f8105e60c9ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.712931 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cde0ef-b7f4-4f7c-b23e-f8105e60c9ce service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.713214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cde0ef-b7f4-4f7c-b23e-f8105e60c9ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.713491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cde0ef-b7f4-4f7c-b23e-f8105e60c9ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.715448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e3cde0ef-b7f4-4f7c-b23e-f8105e60c9ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:55.782090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cde0ef-b7f4-4f7c-b23e-f8105e60c9ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:55.783694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cde0ef-b7f4-4f7c-b23e-f8105e60c9ce service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.788114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941aca67ed1c4eeaa9d9b005d1c8109f', 'request_id': 'req-1c2501e6-af02-4966-9781-56f56a9827bc'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:55.795152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941aca67ed1c4eeaa9d9b005d1c8109f', 'request_id': 'req-1c2501e6-af02-4966-9781-56f56a9827bc'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:55.796258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1053/2109] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:22:55.836998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:55.860227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941aca67ed1c4eeaa9d9b005d1c8109f', 'request_id': 'req-1c2501e6-af02-4966-9781-56f56a9827bc'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:55.872019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] The token cache is being invalidate because project 941aca67ed1c4eeaa9d9b005d1c8109f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:55.872310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:55.873120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-1c2501e6-af02-4966-9781-56f56a9827bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:55.875216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1057/2110] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:55 2022] DELETE /identity/v3/projects/941aca67ed1c4eeaa9d9b005d1c8109f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:55.880334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e5f8b-2b75-4289-8e68-1fbd16182f3b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.880334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e5f8b-2b75-4289-8e68-1fbd16182f3b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.880704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e5f8b-2b75-4289-8e68-1fbd16182f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.900567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-021e5f8b-2b75-4289-8e68-1fbd16182f3b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:55.911600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-021e5f8b-2b75-4289-8e68-1fbd16182f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:55.960506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:55.970037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1054/2111] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:55.979561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e104-9030-4dc6-af5a-23308de759a3 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.979561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e104-9030-4dc6-af5a-23308de759a3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.979561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e104-9030-4dc6-af5a-23308de759a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.011460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-19e8e104-9030-4dc6-af5a-23308de759a3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:56.012996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-19e8e104-9030-4dc6-af5a-23308de759a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:56.026306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1058/2112] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:56.034977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e5f8b-2b75-4289-8e68-1fbd16182f3b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.046436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e5f8b-2b75-4289-8e68-1fbd16182f3b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.051137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b310-a70b-4066-a34f-bdddc6700ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.051807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b310-a70b-4066-a34f-bdddc6700ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.052203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b310-a70b-4066-a34f-bdddc6700ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.052384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b310-a70b-4066-a34f-bdddc6700ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.053117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2b310-a70b-4066-a34f-bdddc6700ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:56.053423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2b310-a70b-4066-a34f-bdddc6700ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.055028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2b310-a70b-4066-a34f-bdddc6700ae4 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.067403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1055/2113] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:56.073392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8e104-9030-4dc6-af5a-23308de759a3 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.083401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8e104-9030-4dc6-af5a-23308de759a3 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.088383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bd4fa-a227-4c2e-b29b-efd3bdff99ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.089048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bd4fa-a227-4c2e-b29b-efd3bdff99ea admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.089336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bd4fa-a227-4c2e-b29b-efd3bdff99ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.089642 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bd4fa-a227-4c2e-b29b-efd3bdff99ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.090376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bd4fa-a227-4c2e-b29b-efd3bdff99ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.092367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bd4fa-a227-4c2e-b29b-efd3bdff99ea admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.108105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:56.251230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b310-a70b-4066-a34f-bdddc6700ae4 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.258053 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1059/2114] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:56 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:56.263831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b310-a70b-4066-a34f-bdddc6700ae4 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.358071 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7e23-aaeb-4c8d-b5b9-033d34161ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.358854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7e23-aaeb-4c8d-b5b9-033d34161ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.359326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7e23-aaeb-4c8d-b5b9-033d34161ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.359767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7e23-aaeb-4c8d-b5b9-033d34161ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.360665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e7e23-aaeb-4c8d-b5b9-033d34161ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.362949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e7e23-aaeb-4c8d-b5b9-033d34161ff0 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.468490 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1056/2115] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:56 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:56.470351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bd4fa-a227-4c2e-b29b-efd3bdff99ea admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.488692 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bd4fa-a227-4c2e-b29b-efd3bdff99ea admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.498652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff33b-e6b1-435a-b73c-4fa27ec0f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.499830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff33b-e6b1-435a-b73c-4fa27ec0f598 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.500386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff33b-e6b1-435a-b73c-4fa27ec0f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.500878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff33b-e6b1-435a-b73c-4fa27ec0f598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.502320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff33b-e6b1-435a-b73c-4fa27ec0f598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.505520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff33b-e6b1-435a-b73c-4fa27ec0f598 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.519031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1060/2116] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:56.523168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7e23-aaeb-4c8d-b5b9-033d34161ff0 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.534299 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7e23-aaeb-4c8d-b5b9-033d34161ff0 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.540276 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e9cbe-7dec-4734-bed0-88754bb9fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.541494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9cbe-7dec-4734-bed0-88754bb9fe70 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.541494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9cbe-7dec-4734-bed0-88754bb9fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.541669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9cbe-7dec-4734-bed0-88754bb9fe70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.542251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e9cbe-7dec-4734-bed0-88754bb9fe70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.544729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e9cbe-7dec-4734-bed0-88754bb9fe70 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.556387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1057/2117] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:56.560954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff33b-e6b1-435a-b73c-4fa27ec0f598 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.572586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff33b-e6b1-435a-b73c-4fa27ec0f598 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.579314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519e7e6-b076-47d7-8eaa-e2fb8b63473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.579952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519e7e6-b076-47d7-8eaa-e2fb8b63473f admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.580070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519e7e6-b076-47d7-8eaa-e2fb8b63473f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.580563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519e7e6-b076-47d7-8eaa-e2fb8b63473f admin admin] PATH_INFO: `/v3/projects/f4d734f6d6a14974b9aa6890401570d3/users/3a92b53c2f52420faaa1c91193af8fc1/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.601359 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519e7e6-b076-47d7-8eaa-e2fb8b63473f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d734f6d6a14974b9aa6890401570d3, user_id=3a92b53c2f52420faaa1c91193af8fc1, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.604091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519e7e6-b076-47d7-8eaa-e2fb8b63473f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.674752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1061/2118] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:56 2022] PUT /identity/v3/projects/f4d734f6d6a14974b9aa6890401570d3/users/3a92b53c2f52420faaa1c91193af8fc1/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:56.686708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cbca1-0c46-43c1-a91e-34dff87c632a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.687268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cbca1-0c46-43c1-a91e-34dff87c632a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.687659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cbca1-0c46-43c1-a91e-34dff87c632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.730260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-175cbca1-0c46-43c1-a91e-34dff87c632a None None] MFA Rules not processed for user `3a92b53c2f52420faaa1c91193af8fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:56.732470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-175cbca1-0c46-43c1-a91e-34dff87c632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:56.822078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1058/2119] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:56.826683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519e7e6-b076-47d7-8eaa-e2fb8b63473f admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.897268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519e7e6-b076-47d7-8eaa-e2fb8b63473f admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.901946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31138f3b-81a1-48b6-8edb-0802a30a22d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.902613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31138f3b-81a1-48b6-8edb-0802a30a22d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.902906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31138f3b-81a1-48b6-8edb-0802a30a22d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.903186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31138f3b-81a1-48b6-8edb-0802a30a22d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.903912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31138f3b-81a1-48b6-8edb-0802a30a22d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.905909 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31138f3b-81a1-48b6-8edb-0802a30a22d3 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:57.035577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1062/2120] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:56 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:57.039160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cbca1-0c46-43c1-a91e-34dff87c632a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:57.050688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cbca1-0c46-43c1-a91e-34dff87c632a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:57.101649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:57.109182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccdd6-54c2-4015-bdf8-9015d53f4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:57.110761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccdd6-54c2-4015-bdf8-9015d53f4989 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.111082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccdd6-54c2-4015-bdf8-9015d53f4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.111364 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccdd6-54c2-4015-bdf8-9015d53f4989 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.112100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ccdd6-54c2-4015-bdf8-9015d53f4989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:57.114095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ccdd6-54c2-4015-bdf8-9015d53f4989 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:57.203403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1059/2121] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:57 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:57.208203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31138f3b-81a1-48b6-8edb-0802a30a22d3 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:57.220854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31138f3b-81a1-48b6-8edb-0802a30a22d3 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:57.225921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6533529-4ba1-435c-9e7b-c842d3d0ec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:57.226507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6533529-4ba1-435c-9e7b-c842d3d0ec20 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.226790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6533529-4ba1-435c-9e7b-c842d3d0ec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.227099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6533529-4ba1-435c-9e7b-c842d3d0ec20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.227916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6533529-4ba1-435c-9e7b-c842d3d0ec20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:57.229530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6533529-4ba1-435c-9e7b-c842d3d0ec20 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:57.240842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1063/2122] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:22:57.245836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccdd6-54c2-4015-bdf8-9015d53f4989 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:57.256546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccdd6-54c2-4015-bdf8-9015d53f4989 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:57.261362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ece6d-fa52-4e7e-b09c-eea1f53e2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:57.262044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ece6d-fa52-4e7e-b09c-eea1f53e2724 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.262330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ece6d-fa52-4e7e-b09c-eea1f53e2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.262609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ece6d-fa52-4e7e-b09c-eea1f53e2724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.263338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ece6d-fa52-4e7e-b09c-eea1f53e2724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:57.264990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ece6d-fa52-4e7e-b09c-eea1f53e2724 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:57.275810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1060/2123] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:57.280628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6533529-4ba1-435c-9e7b-c842d3d0ec20 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:57.292519 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6533529-4ba1-435c-9e7b-c842d3d0ec20 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:57.298299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21b898-c081-4930-98c8-e69213cfd994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:57.299902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b898-c081-4930-98c8-e69213cfd994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.300328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b898-c081-4930-98c8-e69213cfd994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.300736 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b898-c081-4930-98c8-e69213cfd994 admin admin] PATH_INFO: `/v3/projects/bd47848a780a4101ab8d0f31ad19a49b/users/27aed859320d419380deb8edc931661d/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.317476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21b898-c081-4930-98c8-e69213cfd994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd47848a780a4101ab8d0f31ad19a49b, user_id=27aed859320d419380deb8edc931661d, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:57.320294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21b898-c081-4930-98c8-e69213cfd994 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:57.431543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1064/2124] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:57 2022] PUT /identity/v3/projects/bd47848a780a4101ab8d0f31ad19a49b/users/27aed859320d419380deb8edc931661d/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:57.448914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5eff0-07df-4a67-9c4e-250ccecf55a6 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.449437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5eff0-07df-4a67-9c4e-250ccecf55a6 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.450457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5eff0-07df-4a67-9c4e-250ccecf55a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.491420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9ae5eff0-07df-4a67-9c4e-250ccecf55a6 None None] MFA Rules not processed for user `27aed859320d419380deb8edc931661d`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:57.493290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9ae5eff0-07df-4a67-9c4e-250ccecf55a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:57.578644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1061/2125] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:57.582965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21b898-c081-4930-98c8-e69213cfd994 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:57.676745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21b898-c081-4930-98c8-e69213cfd994 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:57.681220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc6841-5aa7-4705-b37c-c085d3687822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:57.682158 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc6841-5aa7-4705-b37c-c085d3687822 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.682508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc6841-5aa7-4705-b37c-c085d3687822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.682900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc6841-5aa7-4705-b37c-c085d3687822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.683675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc6841-5aa7-4705-b37c-c085d3687822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:57.685669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc6841-5aa7-4705-b37c-c085d3687822 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:57.703942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:57.794245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1065/2126] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:57 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:57.800818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5eff0-07df-4a67-9c4e-250ccecf55a6 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:57.809883 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5eff0-07df-4a67-9c4e-250ccecf55a6 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:57.869971 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708569fe-75a7-4419-9780-f87d872a5ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:57.870671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708569fe-75a7-4419-9780-f87d872a5ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.870984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708569fe-75a7-4419-9780-f87d872a5ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.871283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708569fe-75a7-4419-9780-f87d872a5ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.872609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708569fe-75a7-4419-9780-f87d872a5ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:57.874516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708569fe-75a7-4419-9780-f87d872a5ea9 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.003288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1062/2127] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:57 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:58.007124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc6841-5aa7-4705-b37c-c085d3687822 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.018578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc6841-5aa7-4705-b37c-c085d3687822 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.023235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede9333-640d-4200-849f-746996481ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.024023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede9333-640d-4200-849f-746996481ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.024314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede9333-640d-4200-849f-746996481ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.024595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede9333-640d-4200-849f-746996481ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.025330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede9333-640d-4200-849f-746996481ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.027612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede9333-640d-4200-849f-746996481ef8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.031288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708569fe-75a7-4419-9780-f87d872a5ea9 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.033289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-708569fe-75a7-4419-9780-f87d872a5ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:58.039183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1066/2128] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:58.043345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede9333-640d-4200-849f-746996481ef8 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.047656 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708569fe-75a7-4419-9780-f87d872a5ea9 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.052382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.053250 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.055116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.055116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] PATH_INFO: `/v3/users/fb52d81f382247cbb63e6c78d5196ae7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.055302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede9333-640d-4200-849f-746996481ef8 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.055391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb52d81f382247cbb63e6c78d5196ae7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.056949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.059623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b2dd6-674e-49a7-94a9-a903569f5951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.060537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b2dd6-674e-49a7-94a9-a903569f5951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.060826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b2dd6-674e-49a7-94a9-a903569f5951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.061658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b2dd6-674e-49a7-94a9-a903569f5951 admin admin] PATH_INFO: `/v3/projects/2539d721ac2345e59bd6bbf60460aa40/users/cde2adc0d29c4765a8e1cc377cb78865/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.077831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b2dd6-674e-49a7-94a9-a903569f5951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2539d721ac2345e59bd6bbf60460aa40, user_id=cde2adc0d29c4765a8e1cc377cb78865, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.080678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b2dd6-674e-49a7-94a9-a903569f5951 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.194367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1067/2129] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:58 2022] PUT /identity/v3/projects/2539d721ac2345e59bd6bbf60460aa40/users/cde2adc0d29c4765a8e1cc377cb78865/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:58.198293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b2dd6-674e-49a7-94a9-a903569f5951 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.267152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b2dd6-674e-49a7-94a9-a903569f5951 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.272939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e9836-e38a-44aa-93ab-05ba1b0f0e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.273652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9836-e38a-44aa-93ab-05ba1b0f0e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.273914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9836-e38a-44aa-93ab-05ba1b0f0e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.274189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9836-e38a-44aa-93ab-05ba1b0f0e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.274982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e9836-e38a-44aa-93ab-05ba1b0f0e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.279166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e9836-e38a-44aa-93ab-05ba1b0f0e14 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.287683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1068/2130] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:22:58.295970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e9836-e38a-44aa-93ab-05ba1b0f0e14 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.306374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e9836-e38a-44aa-93ab-05ba1b0f0e14 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.312681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc292476-dc03-4f09-9044-59a3e3cc65fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.313823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292476-dc03-4f09-9044-59a3e3cc65fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.313966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292476-dc03-4f09-9044-59a3e3cc65fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.314291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292476-dc03-4f09-9044-59a3e3cc65fe admin admin] PATH_INFO: `/v3/projects/2539d721ac2345e59bd6bbf60460aa40/users/cde2adc0d29c4765a8e1cc377cb78865/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.315244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb52d81f382247cbb63e6c78d5196ae7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:58.316323 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc292476-dc03-4f09-9044-59a3e3cc65fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2539d721ac2345e59bd6bbf60460aa40, user_id=cde2adc0d29c4765a8e1cc377cb78865, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.319130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc292476-dc03-4f09-9044-59a3e3cc65fe admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.319612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:58.329943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1069/2131] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:22:58 2022] PUT /identity/v3/projects/2539d721ac2345e59bd6bbf60460aa40/users/cde2adc0d29c4765a8e1cc377cb78865/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:58.345029 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cf686-53d7-4c25-a368-822bf4fd7638 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.345313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cf686-53d7-4c25-a368-822bf4fd7638 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.345587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cf686-53d7-4c25-a368-822bf4fd7638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.374460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-181cf686-53d7-4c25-a368-822bf4fd7638 None None] MFA Rules not processed for user `cde2adc0d29c4765a8e1cc377cb78865`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:58.375688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-181cf686-53d7-4c25-a368-822bf4fd7638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:58.426624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb52d81f382247cbb63e6c78d5196ae7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:58.442861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb52d81f382247cbb63e6c78d5196ae7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:58.443792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb52d81f382247cbb63e6c78d5196ae7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:58.458445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1070/2132] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:58.459017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb52d81f382247cbb63e6c78d5196ae7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:58.467035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1063/2133] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:58 2022] DELETE /identity/v3/users/fb52d81f382247cbb63e6c78d5196ae7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:58.472046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3b03e-de91-4b3b-b615-0e2d9a760abf None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.472509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3b03e-de91-4b3b-b615-0e2d9a760abf None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.472793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3b03e-de91-4b3b-b615-0e2d9a760abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.478088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.480569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:58.497785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-14c3b03e-de91-4b3b-b615-0e2d9a760abf None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:58.499747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-14c3b03e-de91-4b3b-b615-0e2d9a760abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:58.533038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:58.568185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e9b2b-8349-47ab-85a9-3b893e5b6dc3 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.572353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69bee9-e5fa-4566-95dc-87302ac39c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.573066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69bee9-e5fa-4566-95dc-87302ac39c19 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.573351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69bee9-e5fa-4566-95dc-87302ac39c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.573628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69bee9-e5fa-4566-95dc-87302ac39c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.575633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cf69bee9-e5fa-4566-95dc-87302ac39c19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:58.596254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1071/2134] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:58.605839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3b03e-de91-4b3b-b615-0e2d9a760abf None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.607837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-14c3b03e-de91-4b3b-b615-0e2d9a760abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:58.653351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69bee9-e5fa-4566-95dc-87302ac39c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.654820 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69bee9-e5fa-4566-95dc-87302ac39c19 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.664904 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1064/2135] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:22:58.712095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3b03e-de91-4b3b-b615-0e2d9a760abf None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.726521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d7c5-864a-41c3-9646-dc195b6f0fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.731822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69bee9-e5fa-4566-95dc-87302ac39c19 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.732569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d7c5-864a-41c3-9646-dc195b6f0fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.733132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d7c5-864a-41c3-9646-dc195b6f0fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.733624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d7c5-864a-41c3-9646-dc195b6f0fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.734000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cf69bee9-e5fa-4566-95dc-87302ac39c19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:58.744950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d7c5-864a-41c3-9646-dc195b6f0fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.746479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d7c5-864a-41c3-9646-dc195b6f0fa5 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.755575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69bee9-e5fa-4566-95dc-87302ac39c19 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.758883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1072/2136] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:22:58.763509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.765104 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.766210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.766608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] PATH_INFO: `/v3/users/bd7bd736772e43d7b1f1651b19f53855` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.768132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7bd736772e43d7b1f1651b19f53855)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.770690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.124914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7bd736772e43d7b1f1651b19f53855'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:59.143455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d7c5-864a-41c3-9646-dc195b6f0fa5 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.144903 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9d32d7c5-864a-41c3-9646-dc195b6f0fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:59.168538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d7c5-864a-41c3-9646-dc195b6f0fa5 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.177055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.178708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.179152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.179617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] PATH_INFO: `/v3/projects/31fa1be11da94b1bb60d35198bdecf3b` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.181298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31fa1be11da94b1bb60d35198bdecf3b)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.183295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7bd736772e43d7b1f1651b19f53855'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:59.185402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.197737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7bd736772e43d7b1f1651b19f53855'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:59.198593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7bd736772e43d7b1f1651b19f53855'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:59.201625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:59.208681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1f49b318-c3f4-486b-9252-9f0e5dde1e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7bd736772e43d7b1f1651b19f53855'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:59.215922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1065/2137] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:58 2022] DELETE /identity/v3/users/bd7bd736772e43d7b1f1651b19f53855 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:59.220361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b50a2-47c9-4374-bd0a-a54d8d281765 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.220643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b50a2-47c9-4374-bd0a-a54d8d281765 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.220921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b50a2-47c9-4374-bd0a-a54d8d281765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.248725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f58b50a2-47c9-4374-bd0a-a54d8d281765 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:59.250085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f58b50a2-47c9-4374-bd0a-a54d8d281765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:59.318234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1066/2138] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:22:59.323734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fa1be11da94b1bb60d35198bdecf3b', 'request_id': 'req-fba77a90-9dad-4cf9-99ad-97c3861b2e80'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:59.328748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b50a2-47c9-4374-bd0a-a54d8d281765 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.330156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f58b50a2-47c9-4374-bd0a-a54d8d281765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:59.330779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fa1be11da94b1bb60d35198bdecf3b', 'request_id': 'req-fba77a90-9dad-4cf9-99ad-97c3861b2e80'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:59.392706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b50a2-47c9-4374-bd0a-a54d8d281765 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.431275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fa1be11da94b1bb60d35198bdecf3b', 'request_id': 'req-fba77a90-9dad-4cf9-99ad-97c3861b2e80'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:59.445713 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] The token cache is being invalidate because project 31fa1be11da94b1bb60d35198bdecf3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:22:59.446009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:59.446150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b0872-9437-48dd-900d-109d4abd9290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.446646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fba77a90-9dad-4cf9-99ad-97c3861b2e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:22:59.446805 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b0872-9437-48dd-900d-109d4abd9290 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.448990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b0872-9437-48dd-900d-109d4abd9290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.448990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b0872-9437-48dd-900d-109d4abd9290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.449197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1073/2139] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:22:59 2022] DELETE /identity/v3/projects/31fa1be11da94b1bb60d35198bdecf3b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:59.450345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-085b0872-9437-48dd-900d-109d4abd9290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:59.454097 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ba0b3-570c-41ad-95a2-9ffd17a1ffbd None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.454503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ba0b3-570c-41ad-95a2-9ffd17a1ffbd None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.454746 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ba0b3-570c-41ad-95a2-9ffd17a1ffbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.488287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-311ba0b3-570c-41ad-95a2-9ffd17a1ffbd None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:59.489644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-311ba0b3-570c-41ad-95a2-9ffd17a1ffbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:59.546102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:59.555799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b0872-9437-48dd-900d-109d4abd9290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.557515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b0872-9437-48dd-900d-109d4abd9290 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.559944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1074/2140] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:59.565271 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:59.567500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a728e9-60b6-4806-8d04-642d79d1faa3 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.567781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a728e9-60b6-4806-8d04-642d79d1faa3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.568079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a728e9-60b6-4806-8d04-642d79d1faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.573841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1067/2141] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:22:59.587289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-72a728e9-60b6-4806-8d04-642d79d1faa3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:59.588542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-72a728e9-60b6-4806-8d04-642d79d1faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:59.607380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1075/2142] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:22:59.609227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b0872-9437-48dd-900d-109d4abd9290 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.622854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b0872-9437-48dd-900d-109d4abd9290 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.630064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b9b3-777e-4c46-aca5-646a93831b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.630064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b9b3-777e-4c46-aca5-646a93831b6f admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.630064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b9b3-777e-4c46-aca5-646a93831b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.630064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b9b3-777e-4c46-aca5-646a93831b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.635627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6b9b3-777e-4c46-aca5-646a93831b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:59.635627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6b9b3-777e-4c46-aca5-646a93831b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.635627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6b9b3-777e-4c46-aca5-646a93831b6f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.655902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1068/2143] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:59.665368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a728e9-60b6-4806-8d04-642d79d1faa3 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.678596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a728e9-60b6-4806-8d04-642d79d1faa3 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.686431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fd00c-db12-433b-a753-0e3f78694899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.687518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fd00c-db12-433b-a753-0e3f78694899 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.687518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fd00c-db12-433b-a753-0e3f78694899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.687757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fd00c-db12-433b-a753-0e3f78694899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.688415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fd00c-db12-433b-a753-0e3f78694899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.691695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fd00c-db12-433b-a753-0e3f78694899 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.810833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b9b3-777e-4c46-aca5-646a93831b6f admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.813278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4da6b9b3-777e-4c46-aca5-646a93831b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:59.828004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1076/2144] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:22:59 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:59.830273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b9b3-777e-4c46-aca5-646a93831b6f admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.841441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fd00c-db12-433b-a753-0e3f78694899 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.925644 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.927107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.927455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.927850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] PATH_INFO: `/v3/users/1104f255363741209bbcbb2584a3c491` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.929332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1104f255363741209bbcbb2584a3c491)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.931452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.978059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fd00c-db12-433b-a753-0e3f78694899 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.983446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911bca-acc7-4cab-8327-a5663b480862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.984961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911bca-acc7-4cab-8327-a5663b480862 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.984961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911bca-acc7-4cab-8327-a5663b480862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.984961 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911bca-acc7-4cab-8327-a5663b480862 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.985853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4911bca-acc7-4cab-8327-a5663b480862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.987573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4911bca-acc7-4cab-8327-a5663b480862 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.093351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1077/2145] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:22:59 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:00.094999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911bca-acc7-4cab-8327-a5663b480862 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.111973 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911bca-acc7-4cab-8327-a5663b480862 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.116952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2f6d-e37f-4697-8c87-aac231c32ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.117638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2f6d-e37f-4697-8c87-aac231c32ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.117929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2f6d-e37f-4697-8c87-aac231c32ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.120266 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2f6d-e37f-4697-8c87-aac231c32ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.121238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2f6d-e37f-4697-8c87-aac231c32ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.123151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2f6d-e37f-4697-8c87-aac231c32ba9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.139575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1078/2146] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:23:00.139575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2f6d-e37f-4697-8c87-aac231c32ba9 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.139811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f82b2f6d-e37f-4697-8c87-aac231c32ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:00.153407 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2f6d-e37f-4697-8c87-aac231c32ba9 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.164408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.165230 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.165529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.165853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] PATH_INFO: `/v3/projects/577025acc0f04b608d86fa64ba7bab97` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.167085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577025acc0f04b608d86fa64ba7bab97)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.171340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.206791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1104f255363741209bbcbb2584a3c491'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.291829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577025acc0f04b608d86fa64ba7bab97', 'request_id': 'req-ce0111fe-8a87-417a-8696-74b69c5eb420'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.299829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577025acc0f04b608d86fa64ba7bab97', 'request_id': 'req-ce0111fe-8a87-417a-8696-74b69c5eb420'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.318094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1104f255363741209bbcbb2584a3c491'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.331268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1104f255363741209bbcbb2584a3c491'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.332052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1104f255363741209bbcbb2584a3c491'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.340138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1104f255363741209bbcbb2584a3c491'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.347170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1069/2147] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:22:59 2022] DELETE /identity/v3/users/1104f255363741209bbcbb2584a3c491 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:00.348062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.349885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:00.421828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95005c80-9c87-46e6-beaa-2645ea9c5235 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.426414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0bb94-6237-4aa0-9689-2f968c046119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.427108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0bb94-6237-4aa0-9689-2f968c046119 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.427399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0bb94-6237-4aa0-9689-2f968c046119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.427672 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0bb94-6237-4aa0-9689-2f968c046119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.428424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0bb94-6237-4aa0-9689-2f968c046119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.430021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0bb94-6237-4aa0-9689-2f968c046119 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.435651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:00.441187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1070/2148] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:00.442507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ba6ab-8fd3-4411-9569-2b71a2cba299 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.442796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ba6ab-8fd3-4411-9569-2b71a2cba299 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.443075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ba6ab-8fd3-4411-9569-2b71a2cba299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.453640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577025acc0f04b608d86fa64ba7bab97', 'request_id': 'req-ce0111fe-8a87-417a-8696-74b69c5eb420'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.461508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-fa6ba6ab-8fd3-4411-9569-2b71a2cba299 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:00.463103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fa6ba6ab-8fd3-4411-9569-2b71a2cba299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:00.466425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] The token cache is being invalidate because project 577025acc0f04b608d86fa64ba7bab97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:00.466822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.467477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.472103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1079/2149] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:00 2022] DELETE /identity/v3/projects/577025acc0f04b608d86fa64ba7bab97 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:00.472103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.473461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:00.475453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1071/2150] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:00.482657 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ba6ab-8fd3-4411-9569-2b71a2cba299 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.486590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fa6ba6ab-8fd3-4411-9569-2b71a2cba299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:00.500242 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ba6ab-8fd3-4411-9569-2b71a2cba299 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.509609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:00.511745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.513439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.513731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.514018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] PATH_INFO: `/v3/users/b7bb123a7f9b4afdacde7e0ac4a1ae2b` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.515334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7bb123a7f9b4afdacde7e0ac4a1ae2b)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.517396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.552168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0111fe-8a87-417a-8696-74b69c5eb420 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.559254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e1f00-3af6-4241-a6cf-03440851ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.560688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e1f00-3af6-4241-a6cf-03440851ad54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.561155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e1f00-3af6-4241-a6cf-03440851ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.561263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e1f00-3af6-4241-a6cf-03440851ad54 admin admin] PATH_INFO: `/v3/projects/81684485980545cda977f1d7e72f90e2/users/fac722ebafd540b0b3fe05d83fa39c36/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.582919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e1f00-3af6-4241-a6cf-03440851ad54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81684485980545cda977f1d7e72f90e2, user_id=fac722ebafd540b0b3fe05d83fa39c36, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.589894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e1f00-3af6-4241-a6cf-03440851ad54 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.662566 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1080/2151] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:00 2022] PUT /identity/v3/projects/81684485980545cda977f1d7e72f90e2/users/fac722ebafd540b0b3fe05d83fa39c36/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:00.663994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e1f00-3af6-4241-a6cf-03440851ad54 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.667413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3e9e1f00-3af6-4241-a6cf-03440851ad54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:00.732261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e1f00-3af6-4241-a6cf-03440851ad54 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.736281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e859a7-9a68-4033-82e2-99f6059be04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.736997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e859a7-9a68-4033-82e2-99f6059be04d service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.741839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e859a7-9a68-4033-82e2-99f6059be04d service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.741839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e859a7-9a68-4033-82e2-99f6059be04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.754915 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7bb123a7f9b4afdacde7e0ac4a1ae2b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.809224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e859a7-9a68-4033-82e2-99f6059be04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.810922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e859a7-9a68-4033-82e2-99f6059be04d service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.821994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1081/2152] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:00.823231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ac34d-c318-4d86-a1b0-07e1667c6c9f None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.823518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ac34d-c318-4d86-a1b0-07e1667c6c9f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.823799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ac34d-c318-4d86-a1b0-07e1667c6c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.843779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-690ac34d-c318-4d86-a1b0-07e1667c6c9f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:00.844888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-690ac34d-c318-4d86-a1b0-07e1667c6c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:00.847175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7bb123a7f9b4afdacde7e0ac4a1ae2b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.857287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1082/2153] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:00.874300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7bb123a7f9b4afdacde7e0ac4a1ae2b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.874864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ac34d-c318-4d86-a1b0-07e1667c6c9f None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.875653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7bb123a7f9b4afdacde7e0ac4a1ae2b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.888378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7bb123a7f9b4afdacde7e0ac4a1ae2b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:00.891205 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ac34d-c318-4d86-a1b0-07e1667c6c9f None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.900269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b845cd-0472-4aeb-b3dc-ebfd34cd77ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.900512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1072/2154] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:00 2022] DELETE /identity/v3/users/b7bb123a7f9b4afdacde7e0ac4a1ae2b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:00.900609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b845cd-0472-4aeb-b3dc-ebfd34cd77ac service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.900609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b845cd-0472-4aeb-b3dc-ebfd34cd77ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.900609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b845cd-0472-4aeb-b3dc-ebfd34cd77ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.900956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a9b845cd-0472-4aeb-b3dc-ebfd34cd77ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:00.915020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b845cd-0472-4aeb-b3dc-ebfd34cd77ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.916728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b845cd-0472-4aeb-b3dc-ebfd34cd77ac service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.930033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1083/2155] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:01.503181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:01.508882 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:01.602394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72cfc7-5d00-4bf1-a5ff-7d4ff8c09d65 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:01.607838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:01.608769 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:01.609056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:01.609660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] PATH_INFO: `/v3/projects/884590b0bda54b2dad9712880a3b9588` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:01.611052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=884590b0bda54b2dad9712880a3b9588)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:01.612718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:01.627975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b845cd-0472-4aeb-b3dc-ebfd34cd77ac service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:01.629357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a9b845cd-0472-4aeb-b3dc-ebfd34cd77ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:01.645458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b845cd-0472-4aeb-b3dc-ebfd34cd77ac service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:01.660548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:01.661335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:01.661622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:01.661917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] PATH_INFO: `/v3/projects/1f15f61baa894cb2bf5dcd08a7cd3233` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:01.674044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f15f61baa894cb2bf5dcd08a7cd3233)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:01.674044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:01.798159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:01.807630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884590b0bda54b2dad9712880a3b9588', 'request_id': 'req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:01.810801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f15f61baa894cb2bf5dcd08a7cd3233', 'request_id': 'req-0e810e74-64a2-43f0-968b-cb510868ff46'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:01.815535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884590b0bda54b2dad9712880a3b9588', 'request_id': 'req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:01.820267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f15f61baa894cb2bf5dcd08a7cd3233', 'request_id': 'req-0e810e74-64a2-43f0-968b-cb510868ff46'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:01.900914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884590b0bda54b2dad9712880a3b9588', 'request_id': 'req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:01.909899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:01.934216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] The token cache is being invalidate because project 884590b0bda54b2dad9712880a3b9588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:01.934530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:01.935188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:01.937125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1073/2156] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:01 2022] DELETE /identity/v3/projects/884590b0bda54b2dad9712880a3b9588 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:01.940734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:01.942171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:02.014430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f15f61baa894cb2bf5dcd08a7cd3233', 'request_id': 'req-0e810e74-64a2-43f0-968b-cb510868ff46'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:02.028389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] The token cache is being invalidate because project 1f15f61baa894cb2bf5dcd08a7cd3233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:02.030710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:02.033535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:02.037187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1084/2157] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:01 2022] DELETE /identity/v3/projects/1f15f61baa894cb2bf5dcd08a7cd3233 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:02.038056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:02.040666 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:02.047126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c108cc-368d-4dcd-8cd3-8bbf9ad664ad admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.052475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.054314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.054694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.055531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] PATH_INFO: `/v3/users/1c16242c9b244a3eb95d16d72b7aaa2e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.056826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c16242c9b244a3eb95d16d72b7aaa2e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:02.065330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:02.151633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e810e74-64a2-43f0-968b-cb510868ff46 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.224769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc8038-e9ac-4a84-adc4-5ebf6ee5b2b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.225506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc8038-e9ac-4a84-adc4-5ebf6ee5b2b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.225826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc8038-e9ac-4a84-adc4-5ebf6ee5b2b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.226164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc8038-e9ac-4a84-adc4-5ebf6ee5b2b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.228184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-63fc8038-e9ac-4a84-adc4-5ebf6ee5b2b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:02.305734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c16242c9b244a3eb95d16d72b7aaa2e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:02.326046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc8038-e9ac-4a84-adc4-5ebf6ee5b2b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:02.328096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc8038-e9ac-4a84-adc4-5ebf6ee5b2b1 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:02.343097 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1085/2158] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:02.344843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ae9b1-1e02-410d-a57a-6121e23a20a6 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.345249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ae9b1-1e02-410d-a57a-6121e23a20a6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.346287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ae9b1-1e02-410d-a57a-6121e23a20a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.376232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-fa0ae9b1-1e02-410d-a57a-6121e23a20a6 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:02.382471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-fa0ae9b1-1e02-410d-a57a-6121e23a20a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:02.394673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1086/2159] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:02.400996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a282f5-0c53-4f76-bd65-d75b8d67b0e5 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.401513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a282f5-0c53-4f76-bd65-d75b8d67b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.401896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a282f5-0c53-4f76-bd65-d75b8d67b0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.425061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-55a282f5-0c53-4f76-bd65-d75b8d67b0e5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:02.426289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-55a282f5-0c53-4f76-bd65-d75b8d67b0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:02.436573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1087/2160] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:02.443096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a282f5-0c53-4f76-bd65-d75b8d67b0e5 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:02.454045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c16242c9b244a3eb95d16d72b7aaa2e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:02.458840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a282f5-0c53-4f76-bd65-d75b8d67b0e5 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.467930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2593c20-aa54-4075-8a5f-854bfd09054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.467930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2593c20-aa54-4075-8a5f-854bfd09054c admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.467930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2593c20-aa54-4075-8a5f-854bfd09054c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.467930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2593c20-aa54-4075-8a5f-854bfd09054c admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.468402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2593c20-aa54-4075-8a5f-854bfd09054c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:02.468402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2593c20-aa54-4075-8a5f-854bfd09054c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:02.469353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2593c20-aa54-4075-8a5f-854bfd09054c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:02.474849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c16242c9b244a3eb95d16d72b7aaa2e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:02.476249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c16242c9b244a3eb95d16d72b7aaa2e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:02.488956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1088/2161] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:02.489924 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2593c20-aa54-4075-8a5f-854bfd09054c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:02.492218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b2593c20-aa54-4075-8a5f-854bfd09054c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:02.493894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c16242c9b244a3eb95d16d72b7aaa2e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:02.508223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2593c20-aa54-4075-8a5f-854bfd09054c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.515666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1074/2162] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:01 2022] DELETE /identity/v3/users/1c16242c9b244a3eb95d16d72b7aaa2e => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:02.515787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:02.589742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e28c99-efad-4134-9dae-50c7fc603cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.589996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e28c99-efad-4134-9dae-50c7fc603cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.590431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e28c99-efad-4134-9dae-50c7fc603cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.591396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e28c99-efad-4134-9dae-50c7fc603cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.592234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e28c99-efad-4134-9dae-50c7fc603cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:02.594547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e28c99-efad-4134-9dae-50c7fc603cf4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:02.715313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1089/2163] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:02 2022] POST /identity/v3/projects => generated 369 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:02.720069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:02.735813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fae34-85c8-483c-8a58-8413d1ecdd32 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.852541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29d68-ae4d-4e63-9647-7d692c2c7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.853513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29d68-ae4d-4e63-9647-7d692c2c7fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.853984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29d68-ae4d-4e63-9647-7d692c2c7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.854276 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29d68-ae4d-4e63-9647-7d692c2c7fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.855498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df29d68-ae4d-4e63-9647-7d692c2c7fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:02.858154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df29d68-ae4d-4e63-9647-7d692c2c7fa4 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:02.986941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1075/2164] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:02 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:23:02.991231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e28c99-efad-4134-9dae-50c7fc603cf4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.007665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e28c99-efad-4134-9dae-50c7fc603cf4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.014996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5caa15-7e58-401d-a673-514792c8a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.016283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5caa15-7e58-401d-a673-514792c8a324 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.017218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5caa15-7e58-401d-a673-514792c8a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.017829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5caa15-7e58-401d-a673-514792c8a324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.020938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5caa15-7e58-401d-a673-514792c8a324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.023450 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5caa15-7e58-401d-a673-514792c8a324 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.037812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1090/2165] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:03.042177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29d68-ae4d-4e63-9647-7d692c2c7fa4 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.050361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:03.054522 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29d68-ae4d-4e63-9647-7d692c2c7fa4 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.060728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c3a19-8635-4ab1-a862-f73976a23a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.061698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c3a19-8635-4ab1-a862-f73976a23a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.062027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c3a19-8635-4ab1-a862-f73976a23a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.062752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c3a19-8635-4ab1-a862-f73976a23a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.063419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c3a19-8635-4ab1-a862-f73976a23a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.064445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5caa15-7e58-401d-a673-514792c8a324 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.065208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c3a19-8635-4ab1-a862-f73976a23a44 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.066809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9f5caa15-7e58-401d-a673-514792c8a324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:03.094775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5caa15-7e58-401d-a673-514792c8a324 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.095758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1076/2166] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:03.097008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c3a19-8635-4ab1-a862-f73976a23a44 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.098652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.099607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.099920 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.100269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] PATH_INFO: `/v3/projects/aa0efb82008749e69d6a583ce1bab570` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.102297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0efb82008749e69d6a583ce1bab570)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.106889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.111668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c3a19-8635-4ab1-a862-f73976a23a44 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.122692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1120e9d-8759-45c5-a751-901ded4c1e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.124872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1120e9d-8759-45c5-a751-901ded4c1e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.125385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1120e9d-8759-45c5-a751-901ded4c1e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.126448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1120e9d-8759-45c5-a751-901ded4c1e44 admin admin] PATH_INFO: `/v3/projects/6eab0b08ad8c46cbb2ed5321f998a8d7/users/4e2e56ba2147405ebbca351c49f5ba51/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.166791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1120e9d-8759-45c5-a751-901ded4c1e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eab0b08ad8c46cbb2ed5321f998a8d7, user_id=4e2e56ba2147405ebbca351c49f5ba51, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.170181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1120e9d-8759-45c5-a751-901ded4c1e44 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.270833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1077/2167] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:03 2022] PUT /identity/v3/projects/6eab0b08ad8c46cbb2ed5321f998a8d7/users/4e2e56ba2147405ebbca351c49f5ba51/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:03.283776 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff642-2789-41e0-a7eb-1201de580c00 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.284738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff642-2789-41e0-a7eb-1201de580c00 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.284738 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff642-2789-41e0-a7eb-1201de580c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.290597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0efb82008749e69d6a583ce1bab570', 'request_id': 'req-948a6058-009d-4bf4-be72-367616d6ffe5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:03.299800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0efb82008749e69d6a583ce1bab570', 'request_id': 'req-948a6058-009d-4bf4-be72-367616d6ffe5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:03.326628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-7ddff642-2789-41e0-a7eb-1201de580c00 None None] MFA Rules not processed for user `4e2e56ba2147405ebbca351c49f5ba51`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:03.327214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7ddff642-2789-41e0-a7eb-1201de580c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:03.425194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0efb82008749e69d6a583ce1bab570', 'request_id': 'req-948a6058-009d-4bf4-be72-367616d6ffe5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:03.434736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1078/2168] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:03.437786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] The token cache is being invalidate because project aa0efb82008749e69d6a583ce1bab570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:03.438294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:03.439059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-948a6058-009d-4bf4-be72-367616d6ffe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:03.444092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1091/2169] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:03 2022] DELETE /identity/v3/projects/aa0efb82008749e69d6a583ce1bab570 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:03.449514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3b568-abe6-41b2-8619-1b330c70d7c8 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.450281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddff642-2789-41e0-a7eb-1201de580c00 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.450707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3b568-abe6-41b2-8619-1b330c70d7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.451230 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3b568-abe6-41b2-8619-1b330c70d7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.455114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7ddff642-2789-41e0-a7eb-1201de580c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:03.485037 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-51d3b568-abe6-41b2-8619-1b330c70d7c8 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:03.486346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-51d3b568-abe6-41b2-8619-1b330c70d7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:03.579029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddff642-2789-41e0-a7eb-1201de580c00 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.583655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411c98d-cf37-4db7-8d75-ae80d2460b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.584345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411c98d-cf37-4db7-8d75-ae80d2460b2f service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.584630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411c98d-cf37-4db7-8d75-ae80d2460b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.584907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411c98d-cf37-4db7-8d75-ae80d2460b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.587037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4411c98d-cf37-4db7-8d75-ae80d2460b2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:03.591773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1092/2170] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:03.601102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abc89-dc81-4e1f-a231-0ec5e17c844d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.602047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abc89-dc81-4e1f-a231-0ec5e17c844d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.602255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764abc89-dc81-4e1f-a231-0ec5e17c844d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.603556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411c98d-cf37-4db7-8d75-ae80d2460b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.605575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411c98d-cf37-4db7-8d75-ae80d2460b2f service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.616636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1079/2171] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:23:03.625606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-764abc89-dc81-4e1f-a231-0ec5e17c844d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:03.626915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-764abc89-dc81-4e1f-a231-0ec5e17c844d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:03.642017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411c98d-cf37-4db7-8d75-ae80d2460b2f service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.643449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4411c98d-cf37-4db7-8d75-ae80d2460b2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:03.649946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1093/2172] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:03.655395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abc89-dc81-4e1f-a231-0ec5e17c844d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.659693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411c98d-cf37-4db7-8d75-ae80d2460b2f service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.665671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.666793 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.667157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.667509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] PATH_INFO: `/v3/users/4e2e56ba2147405ebbca351c49f5ba51` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.667676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764abc89-dc81-4e1f-a231-0ec5e17c844d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.669242 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2e56ba2147405ebbca351c49f5ba51)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.671297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.672967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d71ea-0b32-499d-89e8-59d927a6a213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.673848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d71ea-0b32-499d-89e8-59d927a6a213 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.674313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d71ea-0b32-499d-89e8-59d927a6a213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.674795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d71ea-0b32-499d-89e8-59d927a6a213 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.675958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d71ea-0b32-499d-89e8-59d927a6a213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:03.676214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d71ea-0b32-499d-89e8-59d927a6a213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.677833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d71ea-0b32-499d-89e8-59d927a6a213 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.690500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1094/2173] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:03.694665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d71ea-0b32-499d-89e8-59d927a6a213 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.708708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d71ea-0b32-499d-89e8-59d927a6a213 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.712866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff3f67-a1e7-4da9-9d63-51543d89160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.713756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff3f67-a1e7-4da9-9d63-51543d89160f admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.714106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff3f67-a1e7-4da9-9d63-51543d89160f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.714446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff3f67-a1e7-4da9-9d63-51543d89160f admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.715281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff3f67-a1e7-4da9-9d63-51543d89160f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.717838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff3f67-a1e7-4da9-9d63-51543d89160f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.810127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1095/2174] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:03 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:03.814291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff3f67-a1e7-4da9-9d63-51543d89160f admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.899101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff3f67-a1e7-4da9-9d63-51543d89160f admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.905166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd67a7b-3460-4bf1-a4a1-01bcaa5f963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.906196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd67a7b-3460-4bf1-a4a1-01bcaa5f963f admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.906481 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd67a7b-3460-4bf1-a4a1-01bcaa5f963f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.906787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd67a7b-3460-4bf1-a4a1-01bcaa5f963f admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.907504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd67a7b-3460-4bf1-a4a1-01bcaa5f963f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.909598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd67a7b-3460-4bf1-a4a1-01bcaa5f963f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.916799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2e56ba2147405ebbca351c49f5ba51'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:04.002580 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:04.025588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2e56ba2147405ebbca351c49f5ba51'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:04.037797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1096/2175] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:03 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:23:04.038869 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd67a7b-3460-4bf1-a4a1-01bcaa5f963f admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:04.048840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2e56ba2147405ebbca351c49f5ba51'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:04.049703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2e56ba2147405ebbca351c49f5ba51'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:04.055071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd67a7b-3460-4bf1-a4a1-01bcaa5f963f admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:04.060129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-276fae79-2f9a-45fe-8619-72fb1afdf231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2e56ba2147405ebbca351c49f5ba51'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:04.066302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2af75-2c51-4876-a4e9-fc0bec0ea904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:04.066995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2af75-2c51-4876-a4e9-fc0bec0ea904 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.067284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2af75-2c51-4876-a4e9-fc0bec0ea904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.067562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2af75-2c51-4876-a4e9-fc0bec0ea904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.068556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2af75-2c51-4876-a4e9-fc0bec0ea904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:04.070131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2af75-2c51-4876-a4e9-fc0bec0ea904 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:04.075507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1080/2176] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:03 2022] DELETE /identity/v3/users/4e2e56ba2147405ebbca351c49f5ba51 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:04.081437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e17c2-56fb-4e1a-9cc0-265f5e60b48f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.082180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e17c2-56fb-4e1a-9cc0-265f5e60b48f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.082724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e17c2-56fb-4e1a-9cc0-265f5e60b48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.100515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1097/2177] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:04.102140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2af75-2c51-4876-a4e9-fc0bec0ea904 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:04.107922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-46f2af75-2c51-4876-a4e9-fc0bec0ea904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:04.113697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-3b9e17c2-56fb-4e1a-9cc0-265f5e60b48f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:04.116199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3b9e17c2-56fb-4e1a-9cc0-265f5e60b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:04.144482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2af75-2c51-4876-a4e9-fc0bec0ea904 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:04.237612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bcd31-8a59-4fb8-8ab8-f93ba87e6971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:04.238295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bcd31-8a59-4fb8-8ab8-f93ba87e6971 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.238581 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bcd31-8a59-4fb8-8ab8-f93ba87e6971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.238862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bcd31-8a59-4fb8-8ab8-f93ba87e6971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.239612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bcd31-8a59-4fb8-8ab8-f93ba87e6971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:04.241282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bcd31-8a59-4fb8-8ab8-f93ba87e6971 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:04.243073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1081/2178] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:04.244066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e17c2-56fb-4e1a-9cc0-265f5e60b48f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:04.246018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3b9e17c2-56fb-4e1a-9cc0-265f5e60b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:04.256124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1098/2179] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:04.257320 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bcd31-8a59-4fb8-8ab8-f93ba87e6971 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:04.259311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-498bcd31-8a59-4fb8-8ab8-f93ba87e6971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:04.326567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e17c2-56fb-4e1a-9cc0-265f5e60b48f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:04.331174 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c2f82-a375-4778-b379-7292a0f63dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:04.332286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c2f82-a375-4778-b379-7292a0f63dea service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.332286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c2f82-a375-4778-b379-7292a0f63dea service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.332694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c2f82-a375-4778-b379-7292a0f63dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.334891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a25c2f82-a375-4778-b379-7292a0f63dea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:04.342044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bcd31-8a59-4fb8-8ab8-f93ba87e6971 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:04.347132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887d2f1-7cf1-4a21-aad2-1f770418b055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:04.347798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d2f1-7cf1-4a21-aad2-1f770418b055 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.348170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d2f1-7cf1-4a21-aad2-1f770418b055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.348400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d2f1-7cf1-4a21-aad2-1f770418b055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.375842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887d2f1-7cf1-4a21-aad2-1f770418b055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:04.383311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887d2f1-7cf1-4a21-aad2-1f770418b055 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:04.402487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1099/2180] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:04.404252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887d2f1-7cf1-4a21-aad2-1f770418b055 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:04.416314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887d2f1-7cf1-4a21-aad2-1f770418b055 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:04.424175 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fed9a-0764-4b70-a441-a1a35cb344d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:04.424884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fed9a-0764-4b70-a441-a1a35cb344d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.425301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fed9a-0764-4b70-a441-a1a35cb344d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.425587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fed9a-0764-4b70-a441-a1a35cb344d7 admin admin] PATH_INFO: `/v3/projects/da345fbc5c9a476c8e72682372a7ec27/users/2e4f956b66634f19ab3301fcada3aa0e/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.444812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fed9a-0764-4b70-a441-a1a35cb344d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da345fbc5c9a476c8e72682372a7ec27, user_id=2e4f956b66634f19ab3301fcada3aa0e, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:04.448836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fed9a-0764-4b70-a441-a1a35cb344d7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:04.459509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c2f82-a375-4778-b379-7292a0f63dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:04.461083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c2f82-a375-4778-b379-7292a0f63dea service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:04.474375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1082/2181] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:04.519209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1100/2182] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:04 2022] PUT /identity/v3/projects/da345fbc5c9a476c8e72682372a7ec27/users/2e4f956b66634f19ab3301fcada3aa0e/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:04.532299 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c29717-fb19-4a60-b9cf-67e24e512183 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.532836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c29717-fb19-4a60-b9cf-67e24e512183 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.533226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c29717-fb19-4a60-b9cf-67e24e512183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.599229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-47c29717-fb19-4a60-b9cf-67e24e512183 None None] MFA Rules not processed for user `2e4f956b66634f19ab3301fcada3aa0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:04.600874 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-47c29717-fb19-4a60-b9cf-67e24e512183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:04.605164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:04.697369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1083/2183] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:04.702425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fed9a-0764-4b70-a441-a1a35cb344d7 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:04.799576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fed9a-0764-4b70-a441-a1a35cb344d7 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:04.804625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80f44f-1322-4f5d-8bb6-36971e9c8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:04.805308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80f44f-1322-4f5d-8bb6-36971e9c8214 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.805593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80f44f-1322-4f5d-8bb6-36971e9c8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.805872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80f44f-1322-4f5d-8bb6-36971e9c8214 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.806620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80f44f-1322-4f5d-8bb6-36971e9c8214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:04.810073 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80f44f-1322-4f5d-8bb6-36971e9c8214 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:04.930000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1101/2184] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:04 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:04.934643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c29717-fb19-4a60-b9cf-67e24e512183 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:04.969041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c29717-fb19-4a60-b9cf-67e24e512183 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:05.046990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0065e83-3e6d-49a0-8c9b-b36afdf6ff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:05.047918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0065e83-3e6d-49a0-8c9b-b36afdf6ff3d admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:05.048160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0065e83-3e6d-49a0-8c9b-b36afdf6ff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:05.048446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0065e83-3e6d-49a0-8c9b-b36afdf6ff3d admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:05.049171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0065e83-3e6d-49a0-8c9b-b36afdf6ff3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:05.052726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0065e83-3e6d-49a0-8c9b-b36afdf6ff3d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:05.162858 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1084/2185] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:04 2022] POST /identity/v3/users => generated 300 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:05.167984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80f44f-1322-4f5d-8bb6-36971e9c8214 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:05.188156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80f44f-1322-4f5d-8bb6-36971e9c8214 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:05.192038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0065e83-3e6d-49a0-8c9b-b36afdf6ff3d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:05.194192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c2f09-4dec-4a0d-9c61-ac08cb63d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:05.194947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c2f09-4dec-4a0d-9c61-ac08cb63d94f admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:05.195246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c2f09-4dec-4a0d-9c61-ac08cb63d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:05.195533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c2f09-4dec-4a0d-9c61-ac08cb63d94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:05.196322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c2f09-4dec-4a0d-9c61-ac08cb63d94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:05.197060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f0065e83-3e6d-49a0-8c9b-b36afdf6ff3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:05.197956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c2f09-4dec-4a0d-9c61-ac08cb63d94f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:05.230615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0065e83-3e6d-49a0-8c9b-b36afdf6ff3d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:05.230615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:05.230615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:05.230615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:05.231625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] PATH_INFO: `/v3/projects/6eab0b08ad8c46cbb2ed5321f998a8d7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:05.231625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eab0b08ad8c46cbb2ed5321f998a8d7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:05.234295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:05.235998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1102/2186] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:05.237170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c2f09-4dec-4a0d-9c61-ac08cb63d94f admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:05.261842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c2f09-4dec-4a0d-9c61-ac08cb63d94f admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:05.274902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fdc97-d773-448b-a014-652b4d185873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:05.276612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fdc97-d773-448b-a014-652b4d185873 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:05.276894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fdc97-d773-448b-a014-652b4d185873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:05.277170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fdc97-d773-448b-a014-652b4d185873 admin admin] PATH_INFO: `/v3/projects/67eb66ca26ae4b2e8aa2c81a38811c52/users/7fbf5a7bc0244d038ef8a61246541f96/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:05.313710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fdc97-d773-448b-a014-652b4d185873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67eb66ca26ae4b2e8aa2c81a38811c52, user_id=7fbf5a7bc0244d038ef8a61246541f96, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:05.322186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fdc97-d773-448b-a014-652b4d185873 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:05.435150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1103/2187] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:05 2022] PUT /identity/v3/projects/67eb66ca26ae4b2e8aa2c81a38811c52/users/7fbf5a7bc0244d038ef8a61246541f96/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:05.437010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fdc97-d773-448b-a014-652b4d185873 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:05.453797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eab0b08ad8c46cbb2ed5321f998a8d7', 'request_id': 'req-0778e523-6108-4e04-a3a5-9661280d95db'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:05.462463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eab0b08ad8c46cbb2ed5321f998a8d7', 'request_id': 'req-0778e523-6108-4e04-a3a5-9661280d95db'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:05.541549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fdc97-d773-448b-a014-652b4d185873 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:05.562740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eab0b08ad8c46cbb2ed5321f998a8d7', 'request_id': 'req-0778e523-6108-4e04-a3a5-9661280d95db'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:05.580171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] The token cache is being invalidate because project 6eab0b08ad8c46cbb2ed5321f998a8d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:05.580543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:05.581140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0778e523-6108-4e04-a3a5-9661280d95db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:05.583012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1085/2188] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:05 2022] DELETE /identity/v3/projects/6eab0b08ad8c46cbb2ed5321f998a8d7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:05.588165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0e32f-79c3-4758-95ca-cf65f2f7e2e4 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:05.588589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0e32f-79c3-4758-95ca-cf65f2f7e2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:05.588981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0e32f-79c3-4758-95ca-cf65f2f7e2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:05.609753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-3de0e32f-79c3-4758-95ca-cf65f2f7e2e4 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:05.611352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3de0e32f-79c3-4758-95ca-cf65f2f7e2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:05.624040 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124e869-5828-4262-8a29-81dce259df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:05.625166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124e869-5828-4262-8a29-81dce259df86 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:05.625454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124e869-5828-4262-8a29-81dce259df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:05.625795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124e869-5828-4262-8a29-81dce259df86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:05.626593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124e869-5828-4262-8a29-81dce259df86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:05.628603 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124e869-5828-4262-8a29-81dce259df86 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:05.643918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1104/2189] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:05.646486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124e869-5828-4262-8a29-81dce259df86 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:05.648367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d124e869-5828-4262-8a29-81dce259df86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:05.663731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124e869-5828-4262-8a29-81dce259df86 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:05.669197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5847286-e222-4872-a064-e18dd4d5fba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:05.670232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5847286-e222-4872-a064-e18dd4d5fba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:05.670582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5847286-e222-4872-a064-e18dd4d5fba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:05.670936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5847286-e222-4872-a064-e18dd4d5fba8 admin admin] PATH_INFO: `/v3/projects/67eb66ca26ae4b2e8aa2c81a38811c52/users/7fbf5a7bc0244d038ef8a61246541f96/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:05.673377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5847286-e222-4872-a064-e18dd4d5fba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67eb66ca26ae4b2e8aa2c81a38811c52, user_id=7fbf5a7bc0244d038ef8a61246541f96, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:05.678545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5847286-e222-4872-a064-e18dd4d5fba8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:05.693769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1105/2190] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:05 2022] PUT /identity/v3/projects/67eb66ca26ae4b2e8aa2c81a38811c52/users/7fbf5a7bc0244d038ef8a61246541f96/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:05.704413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c635f-ad5d-4a46-b7bd-61d99b1e408d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:05.704745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c635f-ad5d-4a46-b7bd-61d99b1e408d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:05.705090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c635f-ad5d-4a46-b7bd-61d99b1e408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:05.721120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1086/2191] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:05.727442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528906d7-67cd-405a-b52d-13f3125d1191 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:05.727740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528906d7-67cd-405a-b52d-13f3125d1191 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:05.728060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528906d7-67cd-405a-b52d-13f3125d1191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:05.749002 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-528906d7-67cd-405a-b52d-13f3125d1191 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:05.753063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-867c635f-ad5d-4a46-b7bd-61d99b1e408d None None] MFA Rules not processed for user `7fbf5a7bc0244d038ef8a61246541f96`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:05.754062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-528906d7-67cd-405a-b52d-13f3125d1191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:05.754285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-867c635f-ad5d-4a46-b7bd-61d99b1e408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:05.846958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1106/2192] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:23:05.856028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1087/2193] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:23:05.858158 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c635f-ad5d-4a46-b7bd-61d99b1e408d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:05.867816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528906d7-67cd-405a-b52d-13f3125d1191 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:05.870680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-528906d7-67cd-405a-b52d-13f3125d1191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:05.874057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c635f-ad5d-4a46-b7bd-61d99b1e408d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:05.885464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112b08-28df-433d-ab45-a0080e3f739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:05.886780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112b08-28df-433d-ab45-a0080e3f739a admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:05.888186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112b08-28df-433d-ab45-a0080e3f739a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:05.890376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112b08-28df-433d-ab45-a0080e3f739a admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:05.891241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17112b08-28df-433d-ab45-a0080e3f739a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:05.891648 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17112b08-28df-433d-ab45-a0080e3f739a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:05.896569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17112b08-28df-433d-ab45-a0080e3f739a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:05.931055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:05.932542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1107/2194] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:05.936021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112b08-28df-433d-ab45-a0080e3f739a admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:05.961469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112b08-28df-433d-ab45-a0080e3f739a admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:06.001679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409def35-2276-4fc3-ad9a-dffb38bbc9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:06.001679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409def35-2276-4fc3-ad9a-dffb38bbc9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:06.001679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409def35-2276-4fc3-ad9a-dffb38bbc9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:06.004098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409def35-2276-4fc3-ad9a-dffb38bbc9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:06.009160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528906d7-67cd-405a-b52d-13f3125d1191 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:06.010782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409def35-2276-4fc3-ad9a-dffb38bbc9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:06.012888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409def35-2276-4fc3-ad9a-dffb38bbc9e9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:06.015229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3c9e8-4a82-4164-ba69-09a98da8f078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:06.015229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3c9e8-4a82-4164-ba69-09a98da8f078 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:06.015229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3c9e8-4a82-4164-ba69-09a98da8f078 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:06.015229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3c9e8-4a82-4164-ba69-09a98da8f078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:06.025755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3c9e8-4a82-4164-ba69-09a98da8f078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:06.027272 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3c9e8-4a82-4164-ba69-09a98da8f078 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:06.040782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1088/2195] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:23:06.147959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3c9e8-4a82-4164-ba69-09a98da8f078 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:06.155302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3c9e8-4a82-4164-ba69-09a98da8f078 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:06.167756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:06.169172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:06.169631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:06.170087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] PATH_INFO: `/v3/users/2e4f956b66634f19ab3301fcada3aa0e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:06.173452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4f956b66634f19ab3301fcada3aa0e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:06.175637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:06.232523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1108/2196] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:05 2022] POST /identity/v3/projects => generated 377 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:06.236107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409def35-2276-4fc3-ad9a-dffb38bbc9e9 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:06.360000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409def35-2276-4fc3-ad9a-dffb38bbc9e9 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:06.365411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d60a4-5554-4f93-ac61-30099a06145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:06.366318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d60a4-5554-4f93-ac61-30099a06145e admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:06.366690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d60a4-5554-4f93-ac61-30099a06145e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:06.367052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d60a4-5554-4f93-ac61-30099a06145e admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:06.368107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d60a4-5554-4f93-ac61-30099a06145e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:06.370520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d60a4-5554-4f93-ac61-30099a06145e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:06.499442 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1109/2197] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:06 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:06.500548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d60a4-5554-4f93-ac61-30099a06145e admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:06.520595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d60a4-5554-4f93-ac61-30099a06145e admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:06.527730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc1461-7f98-4994-9103-ca4d20c4351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:06.529352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1461-7f98-4994-9103-ca4d20c4351e admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:06.529807 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1461-7f98-4994-9103-ca4d20c4351e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:06.530814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1461-7f98-4994-9103-ca4d20c4351e admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:06.532639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc1461-7f98-4994-9103-ca4d20c4351e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:06.535907 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc1461-7f98-4994-9103-ca4d20c4351e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:06.549529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1110/2198] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:06.553869 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc1461-7f98-4994-9103-ca4d20c4351e admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:06.569685 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc1461-7f98-4994-9103-ca4d20c4351e admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:06.575842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0483e3-e436-4a69-908a-d5428a3a0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:06.576865 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0483e3-e436-4a69-908a-d5428a3a0ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:06.577351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0483e3-e436-4a69-908a-d5428a3a0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:06.577950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0483e3-e436-4a69-908a-d5428a3a0ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:06.578917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0483e3-e436-4a69-908a-d5428a3a0ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:06.580838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0483e3-e436-4a69-908a-d5428a3a0ee8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:06.595955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1111/2199] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:06.600598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0483e3-e436-4a69-908a-d5428a3a0ee8 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:06.614322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0483e3-e436-4a69-908a-d5428a3a0ee8 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:06.616504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4f956b66634f19ab3301fcada3aa0e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:06.622821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9d057-6438-4979-af45-9b324b31832b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:06.624561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9d057-6438-4979-af45-9b324b31832b admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:06.625099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9d057-6438-4979-af45-9b324b31832b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:06.625720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9d057-6438-4979-af45-9b324b31832b admin admin] PATH_INFO: `/v3/projects/62790eb30c9d4a7692891ea901f02819/users/4332b805b09b4f58a11c019eade6fa90/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:06.627895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:06.658645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9d057-6438-4979-af45-9b324b31832b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62790eb30c9d4a7692891ea901f02819, user_id=4332b805b09b4f58a11c019eade6fa90, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:06.663054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9d057-6438-4979-af45-9b324b31832b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:06.719411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4f956b66634f19ab3301fcada3aa0e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:06.733899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4f956b66634f19ab3301fcada3aa0e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:06.734722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4f956b66634f19ab3301fcada3aa0e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:06.743993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1112/2200] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:06 2022] PUT /identity/v3/projects/62790eb30c9d4a7692891ea901f02819/users/4332b805b09b4f58a11c019eade6fa90/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:06.754601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df9bd1-88ce-4099-98e0-c897c696422a None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:06.755844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df9bd1-88ce-4099-98e0-c897c696422a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:06.755844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df9bd1-88ce-4099-98e0-c897c696422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:06.767146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-aa8b0bd6-a107-4903-a59f-b453e7cc7caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4f956b66634f19ab3301fcada3aa0e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:06.779606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1089/2201] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:06 2022] DELETE /identity/v3/users/2e4f956b66634f19ab3301fcada3aa0e => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:06.789370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bd70a-6bb2-4c59-bc97-f5adaf0e9e25 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:06.789661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bd70a-6bb2-4c59-bc97-f5adaf0e9e25 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:06.789947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bd70a-6bb2-4c59-bc97-f5adaf0e9e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:06.800544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-49df9bd1-88ce-4099-98e0-c897c696422a None None] MFA Rules not processed for user `4332b805b09b4f58a11c019eade6fa90`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:06.804988 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-49df9bd1-88ce-4099-98e0-c897c696422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:06.820008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9e8bd70a-6bb2-4c59-bc97-f5adaf0e9e25 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:06.829311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9e8bd70a-6bb2-4c59-bc97-f5adaf0e9e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:06.940954 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1090/2202] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:23:06.952038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bd70a-6bb2-4c59-bc97-f5adaf0e9e25 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:06.953574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1113/2203] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:06.954363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9e8bd70a-6bb2-4c59-bc97-f5adaf0e9e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:06.969338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df9bd1-88ce-4099-98e0-c897c696422a None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:06.971172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-49df9bd1-88ce-4099-98e0-c897c696422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:07.026807 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:07.029234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bd70a-6bb2-4c59-bc97-f5adaf0e9e25 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:07.033257 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61148b9-78ab-48a9-9fd5-0ceeccb2abd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:07.033943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61148b9-78ab-48a9-9fd5-0ceeccb2abd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.034230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61148b9-78ab-48a9-9fd5-0ceeccb2abd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.034514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61148b9-78ab-48a9-9fd5-0ceeccb2abd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.047485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61148b9-78ab-48a9-9fd5-0ceeccb2abd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:07.049103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61148b9-78ab-48a9-9fd5-0ceeccb2abd7 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:07.077845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1091/2204] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:23:07.102575 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df9bd1-88ce-4099-98e0-c897c696422a None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:07.107556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178754c6-5468-4cea-a619-974719873eb7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '979519f42f7d463bb2ee1d5b0bb72a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:07.109670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178754c6-5468-4cea-a619-974719873eb7 service glance] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.109670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178754c6-5468-4cea-a619-974719873eb7 service glance] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.109670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178754c6-5468-4cea-a619-974719873eb7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.121148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178754c6-5468-4cea-a619-974719873eb7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:07.124278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178754c6-5468-4cea-a619-974719873eb7 service glance] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:07.137086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1114/2205] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:07.623371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61148b9-78ab-48a9-9fd5-0ceeccb2abd7 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:07.625277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a61148b9-78ab-48a9-9fd5-0ceeccb2abd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:07.647570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61148b9-78ab-48a9-9fd5-0ceeccb2abd7 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:07.654067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:07.655430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.655563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.655840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] PATH_INFO: `/v3/projects/da345fbc5c9a476c8e72682372a7ec27` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.657637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=da345fbc5c9a476c8e72682372a7ec27)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:07.660001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:07.807124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da345fbc5c9a476c8e72682372a7ec27', 'request_id': 'req-578a788b-404c-4117-a8bf-30f3e5f2e06f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:07.832002 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da345fbc5c9a476c8e72682372a7ec27', 'request_id': 'req-578a788b-404c-4117-a8bf-30f3e5f2e06f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:07.928412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da345fbc5c9a476c8e72682372a7ec27', 'request_id': 'req-578a788b-404c-4117-a8bf-30f3e5f2e06f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:07.948718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] The token cache is being invalidate because project da345fbc5c9a476c8e72682372a7ec27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:07.949327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:07.950776 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-578a788b-404c-4117-a8bf-30f3e5f2e06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:07.955947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1092/2206] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:07 2022] DELETE /identity/v3/projects/da345fbc5c9a476c8e72682372a7ec27 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:07.962463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178754c6-5468-4cea-a619-974719873eb7 service glance] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:07.974249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178754c6-5468-4cea-a619-974719873eb7 service glance] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.061469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.062491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.062824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.063158 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] PATH_INFO: `/v3/users/7fbf5a7bc0244d038ef8a61246541f96` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.064475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fbf5a7bc0244d038ef8a61246541f96)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.066526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.162274 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:08.386555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fbf5a7bc0244d038ef8a61246541f96'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:08.526304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025690ae-1be8-417b-9418-e1d3c614838c None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.528825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025690ae-1be8-417b-9418-e1d3c614838c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.528825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025690ae-1be8-417b-9418-e1d3c614838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.533577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fbf5a7bc0244d038ef8a61246541f96'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:08.555567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-025690ae-1be8-417b-9418-e1d3c614838c None None] MFA Rules not processed for user `fac722ebafd540b0b3fe05d83fa39c36`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:08.557470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-025690ae-1be8-417b-9418-e1d3c614838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:08.560412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fbf5a7bc0244d038ef8a61246541f96'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:08.561678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fbf5a7bc0244d038ef8a61246541f96'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:08.577890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fbf5a7bc0244d038ef8a61246541f96'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:08.600981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1115/2207] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:07 2022] DELETE /identity/v3/users/7fbf5a7bc0244d038ef8a61246541f96 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:08.660722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1093/2208] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:23:08.662634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.666487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:08.747969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d695aad-67da-4d7d-aa11-589f146b19f1 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.752822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c190b-7e97-4069-8ec2-ab3a789804be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.753527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c190b-7e97-4069-8ec2-ab3a789804be admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.754122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c190b-7e97-4069-8ec2-ab3a789804be admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.754413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c190b-7e97-4069-8ec2-ab3a789804be admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.755122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c190b-7e97-4069-8ec2-ab3a789804be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.757106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c190b-7e97-4069-8ec2-ab3a789804be admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.867300 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1116/2209] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:08 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:08.873077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025690ae-1be8-417b-9418-e1d3c614838c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.900611 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025690ae-1be8-417b-9418-e1d3c614838c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.928609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:08.980483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb72a60-9787-4c32-b666-cb0bf8e5f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.981607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb72a60-9787-4c32-b666-cb0bf8e5f6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.981898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb72a60-9787-4c32-b666-cb0bf8e5f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.982178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb72a60-9787-4c32-b666-cb0bf8e5f6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.983247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb72a60-9787-4c32-b666-cb0bf8e5f6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.985417 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb72a60-9787-4c32-b666-cb0bf8e5f6d5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.078341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1094/2210] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:08 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:09.082887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c190b-7e97-4069-8ec2-ab3a789804be admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.094079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c190b-7e97-4069-8ec2-ab3a789804be admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.098797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b9c8e-b026-4249-ac4d-938e5d5eabb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.099478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b9c8e-b026-4249-ac4d-938e5d5eabb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.099764 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b9c8e-b026-4249-ac4d-938e5d5eabb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.100096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b9c8e-b026-4249-ac4d-938e5d5eabb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.100833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b9c8e-b026-4249-ac4d-938e5d5eabb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.102601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b9c8e-b026-4249-ac4d-938e5d5eabb6 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.114438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1117/2211] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:09.118970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb72a60-9787-4c32-b666-cb0bf8e5f6d5 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.129724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb72a60-9787-4c32-b666-cb0bf8e5f6d5 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.140344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc25b7-8be2-4c3f-8faa-969e9fe9ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.142039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc25b7-8be2-4c3f-8faa-969e9fe9ec13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.142039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc25b7-8be2-4c3f-8faa-969e9fe9ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.142039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc25b7-8be2-4c3f-8faa-969e9fe9ec13 admin admin] PATH_INFO: `/v3/projects/e14fe1dee95146a59f3b90f9eb16eb69/users/e9e100eb0fdd4625be1a116e8bcf7576/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.158365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc25b7-8be2-4c3f-8faa-969e9fe9ec13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14fe1dee95146a59f3b90f9eb16eb69, user_id=e9e100eb0fdd4625be1a116e8bcf7576, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.161291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc25b7-8be2-4c3f-8faa-969e9fe9ec13 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.171073 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b9c8e-b026-4249-ac4d-938e5d5eabb6 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.173001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7a5b9c8e-b026-4249-ac4d-938e5d5eabb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:09.190164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b9c8e-b026-4249-ac4d-938e5d5eabb6 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.208712 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.209691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.209914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.210228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] PATH_INFO: `/v3/projects/67eb66ca26ae4b2e8aa2c81a38811c52` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.212007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] RBAC: Authorizing `identity:delete_project(project_id=67eb66ca26ae4b2e8aa2c81a38811c52)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.214890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.282914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1095/2212] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:09 2022] PUT /identity/v3/projects/e14fe1dee95146a59f3b90f9eb16eb69/users/e9e100eb0fdd4625be1a116e8bcf7576/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:09.286892 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc25b7-8be2-4c3f-8faa-969e9fe9ec13 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.354789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc25b7-8be2-4c3f-8faa-969e9fe9ec13 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.360467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204df6d-d000-4d78-9496-0aed3c2d9ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.361192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204df6d-d000-4d78-9496-0aed3c2d9ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.361575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204df6d-d000-4d78-9496-0aed3c2d9ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.361909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204df6d-d000-4d78-9496-0aed3c2d9ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.362669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204df6d-d000-4d78-9496-0aed3c2d9ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.364854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204df6d-d000-4d78-9496-0aed3c2d9ac8 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.386965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1096/2213] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:23:09.392836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204df6d-d000-4d78-9496-0aed3c2d9ac8 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.402124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204df6d-d000-4d78-9496-0aed3c2d9ac8 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.409752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67eb66ca26ae4b2e8aa2c81a38811c52', 'request_id': 'req-861f8045-f765-4534-a0b6-c84fe385935c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:09.417766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67eb66ca26ae4b2e8aa2c81a38811c52', 'request_id': 'req-861f8045-f765-4534-a0b6-c84fe385935c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:09.480116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea9fdd-b383-4e60-a868-4e9a3778f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.480116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea9fdd-b383-4e60-a868-4e9a3778f14f admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.480116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea9fdd-b383-4e60-a868-4e9a3778f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.480116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea9fdd-b383-4e60-a868-4e9a3778f14f admin admin] PATH_INFO: `/v3/projects/e14fe1dee95146a59f3b90f9eb16eb69/users/e9e100eb0fdd4625be1a116e8bcf7576/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.483037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea9fdd-b383-4e60-a868-4e9a3778f14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14fe1dee95146a59f3b90f9eb16eb69, user_id=e9e100eb0fdd4625be1a116e8bcf7576, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.486032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea9fdd-b383-4e60-a868-4e9a3778f14f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.503018 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1097/2214] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:09 2022] PUT /identity/v3/projects/e14fe1dee95146a59f3b90f9eb16eb69/users/e9e100eb0fdd4625be1a116e8bcf7576/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:09.521309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67eb66ca26ae4b2e8aa2c81a38811c52', 'request_id': 'req-861f8045-f765-4534-a0b6-c84fe385935c'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:09.537026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] The token cache is being invalidate because project 67eb66ca26ae4b2e8aa2c81a38811c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:09.537418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:09.538159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-861f8045-f765-4534-a0b6-c84fe385935c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:09.539793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1118/2215] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:09 2022] DELETE /identity/v3/projects/67eb66ca26ae4b2e8aa2c81a38811c52 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:09.547202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624d270-199a-4999-ac69-0a2f963fa1e0 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.547714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624d270-199a-4999-ac69-0a2f963fa1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.548103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624d270-199a-4999-ac69-0a2f963fa1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.567227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a624d270-199a-4999-ac69-0a2f963fa1e0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:09.568476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a624d270-199a-4999-ac69-0a2f963fa1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:09.648067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1098/2216] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:09.653515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe1b0-537a-42c7-a6aa-e2bb238c1250 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.653920 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe1b0-537a-42c7-a6aa-e2bb238c1250 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.654085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe1b0-537a-42c7-a6aa-e2bb238c1250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.674362 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-b9abe1b0-537a-42c7-a6aa-e2bb238c1250 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:09.675629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b9abe1b0-537a-42c7-a6aa-e2bb238c1250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:09.683670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1119/2217] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:09.688809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624d270-199a-4999-ac69-0a2f963fa1e0 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.699037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624d270-199a-4999-ac69-0a2f963fa1e0 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.704689 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a2514-7dd1-4fc5-9bb7-70f1bac0a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.705207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a2514-7dd1-4fc5-9bb7-70f1bac0a864 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.705503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a2514-7dd1-4fc5-9bb7-70f1bac0a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.705806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a2514-7dd1-4fc5-9bb7-70f1bac0a864 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.706553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a2514-7dd1-4fc5-9bb7-70f1bac0a864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:09.706864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a2514-7dd1-4fc5-9bb7-70f1bac0a864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.708771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a2514-7dd1-4fc5-9bb7-70f1bac0a864 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.730425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1099/2218] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:09.731804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abe1b0-537a-42c7-a6aa-e2bb238c1250 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.742900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abe1b0-537a-42c7-a6aa-e2bb238c1250 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.749293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b3764-a796-4168-9b3a-3351a4687261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.750409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b3764-a796-4168-9b3a-3351a4687261 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.750695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b3764-a796-4168-9b3a-3351a4687261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.750999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b3764-a796-4168-9b3a-3351a4687261 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.751705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b3764-a796-4168-9b3a-3351a4687261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.754446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b3764-a796-4168-9b3a-3351a4687261 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.867922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1120/2219] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:09 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:09.872161 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a2514-7dd1-4fc5-9bb7-70f1bac0a864 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.882645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a2514-7dd1-4fc5-9bb7-70f1bac0a864 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.958437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a02d8-07d8-4806-a6c8-5e1507c0a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.959122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a02d8-07d8-4806-a6c8-5e1507c0a21e admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.959410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a02d8-07d8-4806-a6c8-5e1507c0a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.959791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a02d8-07d8-4806-a6c8-5e1507c0a21e admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.960898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a02d8-07d8-4806-a6c8-5e1507c0a21e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.963114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a02d8-07d8-4806-a6c8-5e1507c0a21e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:10.126778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1100/2220] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:09 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:23:10.128142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b3764-a796-4168-9b3a-3351a4687261 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:10.139848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b3764-a796-4168-9b3a-3351a4687261 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:10.145062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ef7db-ce7e-421f-b2db-0b2e26480c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:10.146193 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ef7db-ce7e-421f-b2db-0b2e26480c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:10.146484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ef7db-ce7e-421f-b2db-0b2e26480c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:10.146762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ef7db-ce7e-421f-b2db-0b2e26480c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:10.147918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ef7db-ce7e-421f-b2db-0b2e26480c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:10.149713 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ef7db-ce7e-421f-b2db-0b2e26480c02 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:10.163449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1121/2221] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:10.167516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a02d8-07d8-4806-a6c8-5e1507c0a21e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:10.179159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a02d8-07d8-4806-a6c8-5e1507c0a21e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:10.184679 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2948b7-db01-4c74-bf0f-651d31330d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:10.185472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2948b7-db01-4c74-bf0f-651d31330d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:10.189384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2948b7-db01-4c74-bf0f-651d31330d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:10.189384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2948b7-db01-4c74-bf0f-651d31330d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:10.189384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2948b7-db01-4c74-bf0f-651d31330d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:10.189384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2948b7-db01-4c74-bf0f-651d31330d86 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:10.209137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ef7db-ce7e-421f-b2db-0b2e26480c02 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:10.220832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1101/2222] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:23:10.224699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ef7db-ce7e-421f-b2db-0b2e26480c02 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:10.230232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb6c5-233a-4636-baef-db6fba8dc808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:10.231685 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb6c5-233a-4636-baef-db6fba8dc808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:10.232001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb6c5-233a-4636-baef-db6fba8dc808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:10.232287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfb6c5-233a-4636-baef-db6fba8dc808 admin admin] PATH_INFO: `/v3/projects/efbdb48f4eaa43bc92180b1cf1c5edb3/users/71b7d566d47b401e939ea6ef4180a3aa/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:10.256525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfb6c5-233a-4636-baef-db6fba8dc808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbdb48f4eaa43bc92180b1cf1c5edb3, user_id=71b7d566d47b401e939ea6ef4180a3aa, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:10.263978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfb6c5-233a-4636-baef-db6fba8dc808 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:10.404855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf4c7e-96b8-4e0e-ab87-cba7ceaabb74 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:10.405685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf4c7e-96b8-4e0e-ab87-cba7ceaabb74 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:10.406121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf4c7e-96b8-4e0e-ab87-cba7ceaabb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:10.407813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1122/2223] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:10 2022] PUT /identity/v3/projects/efbdb48f4eaa43bc92180b1cf1c5edb3/users/71b7d566d47b401e939ea6ef4180a3aa/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:10.437587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-faaf4c7e-96b8-4e0e-ab87-cba7ceaabb74 None None] MFA Rules not processed for user `71b7d566d47b401e939ea6ef4180a3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:10.438819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-faaf4c7e-96b8-4e0e-ab87-cba7ceaabb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:10.580961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1102/2224] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:10.581162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb6c5-233a-4636-baef-db6fba8dc808 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:10.638839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:10.667504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfb6c5-233a-4636-baef-db6fba8dc808 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:10.672974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f548f-aea6-48d3-ba60-2055cd7e40a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:10.673650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f548f-aea6-48d3-ba60-2055cd7e40a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:10.673934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f548f-aea6-48d3-ba60-2055cd7e40a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:10.674208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f548f-aea6-48d3-ba60-2055cd7e40a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:10.674905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f548f-aea6-48d3-ba60-2055cd7e40a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:10.676875 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f548f-aea6-48d3-ba60-2055cd7e40a6 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:10.699662 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:10.791762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1123/2225] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:10 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:10.793166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf4c7e-96b8-4e0e-ab87-cba7ceaabb74 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:10.806101 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf4c7e-96b8-4e0e-ab87-cba7ceaabb74 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:10.890488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f548f-aea6-48d3-ba60-2055cd7e40a6 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:10.892356 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1e8f548f-aea6-48d3-ba60-2055cd7e40a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:10.914172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2297427-71f6-4531-8e5d-be18c1b0db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:10.914868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2297427-71f6-4531-8e5d-be18c1b0db33 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:10.915153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2297427-71f6-4531-8e5d-be18c1b0db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:10.915428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2297427-71f6-4531-8e5d-be18c1b0db33 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:10.916165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2297427-71f6-4531-8e5d-be18c1b0db33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:10.918134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2297427-71f6-4531-8e5d-be18c1b0db33 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:10.966766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f548f-aea6-48d3-ba60-2055cd7e40a6 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:10.971801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:10.972723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:10.973325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:10.973325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] PATH_INFO: `/v3/users/3a92b53c2f52420faaa1c91193af8fc1` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:10.974516 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a92b53c2f52420faaa1c91193af8fc1)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:10.976500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:11.008694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1103/2226] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:10 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:11.012605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2297427-71f6-4531-8e5d-be18c1b0db33 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.022739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2297427-71f6-4531-8e5d-be18c1b0db33 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.027529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bab491-9f63-4f0f-abbe-3d357bde685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.028252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bab491-9f63-4f0f-abbe-3d357bde685c admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.028542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bab491-9f63-4f0f-abbe-3d357bde685c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.028826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bab491-9f63-4f0f-abbe-3d357bde685c admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.029623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bab491-9f63-4f0f-abbe-3d357bde685c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:11.031221 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bab491-9f63-4f0f-abbe-3d357bde685c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:11.041902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1104/2227] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:23:11.046434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bab491-9f63-4f0f-abbe-3d357bde685c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.056132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bab491-9f63-4f0f-abbe-3d357bde685c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.061755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1514d-6eda-4b4f-8af0-1cbe6ee20e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.064029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1514d-6eda-4b4f-8af0-1cbe6ee20e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.064326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1514d-6eda-4b4f-8af0-1cbe6ee20e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.064618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1514d-6eda-4b4f-8af0-1cbe6ee20e7d admin admin] PATH_INFO: `/v3/projects/c6960d56b4694141821b871c0c95edbc/users/f58f8893dd31487b910171ef6f9e214a/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.085293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1514d-6eda-4b4f-8af0-1cbe6ee20e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6960d56b4694141821b871c0c95edbc, user_id=f58f8893dd31487b910171ef6f9e214a, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:11.090713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1514d-6eda-4b4f-8af0-1cbe6ee20e7d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:11.165821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1105/2228] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:11 2022] PUT /identity/v3/projects/c6960d56b4694141821b871c0c95edbc/users/f58f8893dd31487b910171ef6f9e214a/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:11.170046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1514d-6eda-4b4f-8af0-1cbe6ee20e7d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.177018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a92b53c2f52420faaa1c91193af8fc1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:11.255003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1514d-6eda-4b4f-8af0-1cbe6ee20e7d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.261369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf498c-94c4-4327-99d3-994cd869a297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.262768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf498c-94c4-4327-99d3-994cd869a297 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.263180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf498c-94c4-4327-99d3-994cd869a297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.263523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf498c-94c4-4327-99d3-994cd869a297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.264438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf498c-94c4-4327-99d3-994cd869a297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:11.266118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf498c-94c4-4327-99d3-994cd869a297 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:11.278995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1106/2229] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:11.282760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf498c-94c4-4327-99d3-994cd869a297 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.288835 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a92b53c2f52420faaa1c91193af8fc1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:11.314741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a92b53c2f52420faaa1c91193af8fc1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:11.315316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf498c-94c4-4327-99d3-994cd869a297 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.315398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a92b53c2f52420faaa1c91193af8fc1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:11.322464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-64f13491-8657-472a-9753-f0fe103fe5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a92b53c2f52420faaa1c91193af8fc1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:11.323473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20e5b2-ac25-4a06-84e9-7622cd67ff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.325137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20e5b2-ac25-4a06-84e9-7622cd67ff13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.326728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20e5b2-ac25-4a06-84e9-7622cd67ff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.327798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20e5b2-ac25-4a06-84e9-7622cd67ff13 admin admin] PATH_INFO: `/v3/projects/c6960d56b4694141821b871c0c95edbc/users/f58f8893dd31487b910171ef6f9e214a/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.333500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20e5b2-ac25-4a06-84e9-7622cd67ff13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6960d56b4694141821b871c0c95edbc, user_id=f58f8893dd31487b910171ef6f9e214a, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:11.338020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20e5b2-ac25-4a06-84e9-7622cd67ff13 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:11.341638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1124/2230] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:10 2022] DELETE /identity/v3/users/3a92b53c2f52420faaa1c91193af8fc1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:11.343573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f053b1-b7f5-403e-b14e-301298cee191 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.343989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f053b1-b7f5-403e-b14e-301298cee191 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.344282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f053b1-b7f5-403e-b14e-301298cee191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.375857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-39f053b1-b7f5-403e-b14e-301298cee191 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:11.390417 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1107/2231] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:11 2022] PUT /identity/v3/projects/c6960d56b4694141821b871c0c95edbc/users/f58f8893dd31487b910171ef6f9e214a/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:11.398872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f067ae-eeea-4f2e-9f03-42c85aae083f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.399390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f067ae-eeea-4f2e-9f03-42c85aae083f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.399892 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f067ae-eeea-4f2e-9f03-42c85aae083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.406855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-39f053b1-b7f5-403e-b14e-301298cee191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:11.446590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-66f067ae-eeea-4f2e-9f03-42c85aae083f None None] MFA Rules not processed for user `f58f8893dd31487b910171ef6f9e214a`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:11.448908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-66f067ae-eeea-4f2e-9f03-42c85aae083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:11.503748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1125/2232] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:23:11.517967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f053b1-b7f5-403e-b14e-301298cee191 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.521676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-39f053b1-b7f5-403e-b14e-301298cee191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:11.560245 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1108/2233] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:11.568383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f067ae-eeea-4f2e-9f03-42c85aae083f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.570498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-66f067ae-eeea-4f2e-9f03-42c85aae083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:11.614104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f053b1-b7f5-403e-b14e-301298cee191 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.626621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dbf4f-d984-427d-ad54-324c4432fb6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.627669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dbf4f-d984-427d-ad54-324c4432fb6f service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.628202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dbf4f-d984-427d-ad54-324c4432fb6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.628693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dbf4f-d984-427d-ad54-324c4432fb6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.642836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dbf4f-d984-427d-ad54-324c4432fb6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:11.644569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dbf4f-d984-427d-ad54-324c4432fb6f service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:11.671199 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1126/2234] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:23:11.693203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f067ae-eeea-4f2e-9f03-42c85aae083f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.697795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5d6e7-d501-453d-8525-a84a02a90527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.698464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5d6e7-d501-453d-8525-a84a02a90527 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.698751 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5d6e7-d501-453d-8525-a84a02a90527 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.699116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5d6e7-d501-453d-8525-a84a02a90527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.715055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5d6e7-d501-453d-8525-a84a02a90527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:11.717221 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5d6e7-d501-453d-8525-a84a02a90527 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:11.730413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1109/2235] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:11.941956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dbf4f-d984-427d-ad54-324c4432fb6f service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.962399 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dbf4f-d984-427d-ad54-324c4432fb6f service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.978904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124bcff-ad36-4d07-8d06-9313cbf31d9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.979583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124bcff-ad36-4d07-8d06-9313cbf31d9f service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.979888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124bcff-ad36-4d07-8d06-9313cbf31d9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.980210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124bcff-ad36-4d07-8d06-9313cbf31d9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.982642 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6124bcff-ad36-4d07-8d06-9313cbf31d9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:12.067150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124bcff-ad36-4d07-8d06-9313cbf31d9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.069460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124bcff-ad36-4d07-8d06-9313cbf31d9f service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.084759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1127/2236] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:12.291452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:12.297156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5d6e7-d501-453d-8525-a84a02a90527 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.299646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f7e5d6e7-d501-453d-8525-a84a02a90527 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:12.346400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5d6e7-d501-453d-8525-a84a02a90527 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.355519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.356622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.357011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.357403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] PATH_INFO: `/v3/projects/f4d734f6d6a14974b9aa6890401570d3` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.358781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d734f6d6a14974b9aa6890401570d3)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.361096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.507621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d734f6d6a14974b9aa6890401570d3', 'request_id': 'req-b8f8227b-dfe3-416e-acda-1e8872c57272'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:12.515213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d734f6d6a14974b9aa6890401570d3', 'request_id': 'req-b8f8227b-dfe3-416e-acda-1e8872c57272'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:12.590823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d734f6d6a14974b9aa6890401570d3', 'request_id': 'req-b8f8227b-dfe3-416e-acda-1e8872c57272'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:12.610775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] The token cache is being invalidate because project f4d734f6d6a14974b9aa6890401570d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:12.611415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:12.614445 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:12.616767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1110/2237] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:12 2022] DELETE /identity/v3/projects/f4d734f6d6a14974b9aa6890401570d3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:12.632185 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124bcff-ad36-4d07-8d06-9313cbf31d9f service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.643695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124bcff-ad36-4d07-8d06-9313cbf31d9f service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.709905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.710866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.711325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.711438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] PATH_INFO: `/v3/users/27aed859320d419380deb8edc931661d` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.713005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] RBAC: Authorizing `identity:delete_user(user_id=27aed859320d419380deb8edc931661d)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.715004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.756260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.757771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:12.771501 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8227b-dfe3-416e-acda-1e8872c57272 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.776258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.777405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.781990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.781990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] PATH_INFO: `/v3/users/71b7d566d47b401e939ea6ef4180a3aa` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.781990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b7d566d47b401e939ea6ef4180a3aa)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.781990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.960676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27aed859320d419380deb8edc931661d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:13.017499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b7d566d47b401e939ea6ef4180a3aa'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:13.117415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27aed859320d419380deb8edc931661d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:13.134242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27aed859320d419380deb8edc931661d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:13.135001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27aed859320d419380deb8edc931661d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:13.154790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6a7e2c91-4c7a-44b8-bfbe-27c2a728120f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27aed859320d419380deb8edc931661d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:13.164190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1128/2238] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:12 2022] DELETE /identity/v3/users/27aed859320d419380deb8edc931661d => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:13.253869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b7d566d47b401e939ea6ef4180a3aa'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:13.280949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b7d566d47b401e939ea6ef4180a3aa'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:13.285179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b7d566d47b401e939ea6ef4180a3aa'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:13.299986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b7d566d47b401e939ea6ef4180a3aa'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:13.311229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1111/2239] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:12 2022] DELETE /identity/v3/users/71b7d566d47b401e939ea6ef4180a3aa => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:13.316085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00746b31-ce8b-4e3f-a232-29031b05321e None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.316904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00746b31-ce8b-4e3f-a232-29031b05321e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.317917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00746b31-ce8b-4e3f-a232-29031b05321e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.341542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-00746b31-ce8b-4e3f-a232-29031b05321e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:13.341725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:13.342968 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-00746b31-ce8b-4e3f-a232-29031b05321e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:13.515833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1129/2240] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:23:13.533215 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.535121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:13.638556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c15bf-e158-4522-91a9-89e2cef3f12b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.644370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018edfc2-26c3-475e-a5bb-c688ea528418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.645298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018edfc2-26c3-475e-a5bb-c688ea528418 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.645792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018edfc2-26c3-475e-a5bb-c688ea528418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.646277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018edfc2-26c3-475e-a5bb-c688ea528418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.662438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018edfc2-26c3-475e-a5bb-c688ea528418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.666119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018edfc2-26c3-475e-a5bb-c688ea528418 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:13.685051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1112/2241] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:13.795626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00746b31-ce8b-4e3f-a232-29031b05321e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.800101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-00746b31-ce8b-4e3f-a232-29031b05321e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:13.814464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00746b31-ce8b-4e3f-a232-29031b05321e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.844913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.845960 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.846622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.847089 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] PATH_INFO: `/v3/projects/bd47848a780a4101ab8d0f31ad19a49b` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.848455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd47848a780a4101ab8d0f31ad19a49b)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.853216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.018102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd47848a780a4101ab8d0f31ad19a49b', 'request_id': 'req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.031904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd47848a780a4101ab8d0f31ad19a49b', 'request_id': 'req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.096567 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd47848a780a4101ab8d0f31ad19a49b', 'request_id': 'req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.120142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] The token cache is being invalidate because project bd47848a780a4101ab8d0f31ad19a49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:14.120490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.121365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.130463 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1130/2242] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:13 2022] DELETE /identity/v3/projects/bd47848a780a4101ab8d0f31ad19a49b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:14.131467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018edfc2-26c3-475e-a5bb-c688ea528418 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.149725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018edfc2-26c3-475e-a5bb-c688ea528418 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.236836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:14.322893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.324024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.324300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.324810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] PATH_INFO: `/v3/users/cde2adc0d29c4765a8e1cc377cb78865` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.327080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde2adc0d29c4765a8e1cc377cb78865)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.329328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.470101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.471900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:14.512785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bf970-48fa-41fd-a4c6-68ed0cece14b admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.526019 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.526966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.527250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.527529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] PATH_INFO: `/v3/projects/efbdb48f4eaa43bc92180b1cf1c5edb3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.532177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbdb48f4eaa43bc92180b1cf1c5edb3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.542288 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.622665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde2adc0d29c4765a8e1cc377cb78865'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.707696 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde2adc0d29c4765a8e1cc377cb78865'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.763051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbdb48f4eaa43bc92180b1cf1c5edb3', 'request_id': 'req-b35482b2-81b7-417a-b350-0f65f85c0936'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.777013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbdb48f4eaa43bc92180b1cf1c5edb3', 'request_id': 'req-b35482b2-81b7-417a-b350-0f65f85c0936'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.779172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde2adc0d29c4765a8e1cc377cb78865'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.781274 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde2adc0d29c4765a8e1cc377cb78865'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.795030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde2adc0d29c4765a8e1cc377cb78865'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.804571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1113/2243] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:14 2022] DELETE /identity/v3/users/cde2adc0d29c4765a8e1cc377cb78865 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:14.899916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbdb48f4eaa43bc92180b1cf1c5edb3', 'request_id': 'req-b35482b2-81b7-417a-b350-0f65f85c0936'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.923143 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] The token cache is being invalidate because project efbdb48f4eaa43bc92180b1cf1c5edb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:14.923827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.925879 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:14.931462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1131/2244] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:14 2022] DELETE /identity/v3/projects/efbdb48f4eaa43bc92180b1cf1c5edb3 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:14.937824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.939662 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:15.099025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55872e86-0274-4665-b9d7-0575c8bc7cc6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:15.132169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:15.133816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:15.134347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:15.135077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] PATH_INFO: `/v3/users/f58f8893dd31487b910171ef6f9e214a` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:15.137743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58f8893dd31487b910171ef6f9e214a)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:15.141767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.490870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58f8893dd31487b910171ef6f9e214a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:15.520026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:15.521494 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:15.605289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58f8893dd31487b910171ef6f9e214a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:15.652545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58f8893dd31487b910171ef6f9e214a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:15.655503 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58f8893dd31487b910171ef6f9e214a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:15.682875 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a5f1f3bb-e116-4b5d-8cc2-1bcd1e6e3a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58f8893dd31487b910171ef6f9e214a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:15.684197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35482b2-81b7-417a-b350-0f65f85c0936 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:15.692857 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1114/2245] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:14 2022] DELETE /identity/v3/users/f58f8893dd31487b910171ef6f9e214a => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:15.702407 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:15.703503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:15.703788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:15.704116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] PATH_INFO: `/v3/projects/2539d721ac2345e59bd6bbf60460aa40` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:15.706088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2539d721ac2345e59bd6bbf60460aa40)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:15.708998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.740613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:15.903099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2539d721ac2345e59bd6bbf60460aa40', 'request_id': 'req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:15.913079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2539d721ac2345e59bd6bbf60460aa40', 'request_id': 'req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:16.006620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2539d721ac2345e59bd6bbf60460aa40', 'request_id': 'req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:16.034161 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] The token cache is being invalidate because project 2539d721ac2345e59bd6bbf60460aa40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:16.035077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:16.050593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2eaaf673-d6ec-4b97-a8c4-5d110b44f0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:16.054082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1132/2246] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:15 2022] DELETE /identity/v3/projects/2539d721ac2345e59bd6bbf60460aa40 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:16.064032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70e9d-25c0-49cb-b498-e71aaaa297e6 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.064352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70e9d-25c0-49cb-b498-e71aaaa297e6 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.064639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70e9d-25c0-49cb-b498-e71aaaa297e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.118694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-92c70e9d-25c0-49cb-b498-e71aaaa297e6 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:16.122241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-92c70e9d-25c0-49cb-b498-e71aaaa297e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:16.280653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1115/2247] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:16.285532 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962309-897a-4636-b8ef-3b39a6888884 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.285833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962309-897a-4636-b8ef-3b39a6888884 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.288283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962309-897a-4636-b8ef-3b39a6888884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.338231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-5f962309-897a-4636-b8ef-3b39a6888884 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:16.339838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5f962309-897a-4636-b8ef-3b39a6888884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:16.364848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1133/2248] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:23:16.368943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70e9d-25c0-49cb-b498-e71aaaa297e6 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.381125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70e9d-25c0-49cb-b498-e71aaaa297e6 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.394796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fecb89-6776-4db3-9fd0-f25b8839493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.395460 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fecb89-6776-4db3-9fd0-f25b8839493a admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.395747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fecb89-6776-4db3-9fd0-f25b8839493a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.396061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fecb89-6776-4db3-9fd0-f25b8839493a admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.397015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fecb89-6776-4db3-9fd0-f25b8839493a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:16.400859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fecb89-6776-4db3-9fd0-f25b8839493a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.400859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fecb89-6776-4db3-9fd0-f25b8839493a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.414828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1116/2249] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:16.419887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f962309-897a-4636-b8ef-3b39a6888884 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.438236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f962309-897a-4636-b8ef-3b39a6888884 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.443972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7b1d6-b7bb-4656-9e24-533a96b30467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.445612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7b1d6-b7bb-4656-9e24-533a96b30467 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.447438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7b1d6-b7bb-4656-9e24-533a96b30467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.448072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7b1d6-b7bb-4656-9e24-533a96b30467 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.448546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7b1d6-b7bb-4656-9e24-533a96b30467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.450992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7b1d6-b7bb-4656-9e24-533a96b30467 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.518677 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fecb89-6776-4db3-9fd0-f25b8839493a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.520613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a5fecb89-6776-4db3-9fd0-f25b8839493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:16.536666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fecb89-6776-4db3-9fd0-f25b8839493a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.550457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.551516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.551991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.552285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] PATH_INFO: `/v3/projects/c6960d56b4694141821b871c0c95edbc` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.553653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6960d56b4694141821b871c0c95edbc)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.555800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.621744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1134/2250] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:16 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:16.625965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7b1d6-b7bb-4656-9e24-533a96b30467 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.692425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7b1d6-b7bb-4656-9e24-533a96b30467 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.697598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad0d1-842e-4a19-8138-a415b49d8cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.698281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad0d1-842e-4a19-8138-a415b49d8cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.698568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad0d1-842e-4a19-8138-a415b49d8cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.698846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad0d1-842e-4a19-8138-a415b49d8cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.699545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ad0d1-842e-4a19-8138-a415b49d8cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.702479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ad0d1-842e-4a19-8138-a415b49d8cd8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.723236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6960d56b4694141821b871c0c95edbc', 'request_id': 'req-9703cc20-784e-4c35-866d-bf6ca7118f64'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:16.733253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6960d56b4694141821b871c0c95edbc', 'request_id': 'req-9703cc20-784e-4c35-866d-bf6ca7118f64'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:16.811860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1135/2251] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:16 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:23:16.812981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad0d1-842e-4a19-8138-a415b49d8cd8 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.818352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6960d56b4694141821b871c0c95edbc', 'request_id': 'req-9703cc20-784e-4c35-866d-bf6ca7118f64'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:16.823988 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:16.828956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad0d1-842e-4a19-8138-a415b49d8cd8 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.836015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] The token cache is being invalidate because project c6960d56b4694141821b871c0c95edbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:16.837755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:16.839309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9703cc20-784e-4c35-866d-bf6ca7118f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:16.846202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1117/2252] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:16 2022] DELETE /identity/v3/projects/c6960d56b4694141821b871c0c95edbc => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:16.854162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0074c-0785-4a88-a2b1-4e0782a99c14 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.854455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0074c-0785-4a88-a2b1-4e0782a99c14 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.857636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0074c-0785-4a88-a2b1-4e0782a99c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.886113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f3c0074c-0785-4a88-a2b1-4e0782a99c14 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:16.887313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f3c0074c-0785-4a88-a2b1-4e0782a99c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:16.934936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62650c1b-574d-432e-8d12-39c0a7a8fdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.935625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62650c1b-574d-432e-8d12-39c0a7a8fdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.936119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62650c1b-574d-432e-8d12-39c0a7a8fdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.936543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62650c1b-574d-432e-8d12-39c0a7a8fdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.939139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62650c1b-574d-432e-8d12-39c0a7a8fdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.942407 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62650c1b-574d-432e-8d12-39c0a7a8fdb5 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.959727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1136/2253] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:16.964957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62650c1b-574d-432e-8d12-39c0a7a8fdb5 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.970151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-62650c1b-574d-432e-8d12-39c0a7a8fdb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:17.006813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62650c1b-574d-432e-8d12-39c0a7a8fdb5 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.016951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09f0fa-802e-46b8-a756-e7fd061e9e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.018020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09f0fa-802e-46b8-a756-e7fd061e9e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.018373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09f0fa-802e-46b8-a756-e7fd061e9e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.018726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09f0fa-802e-46b8-a756-e7fd061e9e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.019793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09f0fa-802e-46b8-a756-e7fd061e9e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.021727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09f0fa-802e-46b8-a756-e7fd061e9e5b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.036928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:17.061076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1118/2254] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:17.061283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1137/2255] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:17.068705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d8f4e-8b31-49a7-91ac-091eea75ed2b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.068928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d8f4e-8b31-49a7-91ac-091eea75ed2b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.069317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d8f4e-8b31-49a7-91ac-091eea75ed2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.073921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09f0fa-802e-46b8-a756-e7fd061e9e5b admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.083949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09f0fa-802e-46b8-a756-e7fd061e9e5b admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.099631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffc200-41af-4a42-925b-5e458037ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.100576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffc200-41af-4a42-925b-5e458037ed87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.101017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffc200-41af-4a42-925b-5e458037ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.101583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffc200-41af-4a42-925b-5e458037ed87 admin admin] PATH_INFO: `/v3/projects/d8e983852747461b8ca663cd6ff56ff4/users/022e761cfc694697b0ef9886025abc5e/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.125828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-569d8f4e-8b31-49a7-91ac-091eea75ed2b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:17.126829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffc200-41af-4a42-925b-5e458037ed87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e983852747461b8ca663cd6ff56ff4, user_id=022e761cfc694697b0ef9886025abc5e, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.130094 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffc200-41af-4a42-925b-5e458037ed87 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.134003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-569d8f4e-8b31-49a7-91ac-091eea75ed2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:17.144768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1119/2256] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:17.150451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d8f4e-8b31-49a7-91ac-091eea75ed2b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.163411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d8f4e-8b31-49a7-91ac-091eea75ed2b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.171282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f82489-88cd-45bd-bfbd-c49a56d6d069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.171986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f82489-88cd-45bd-bfbd-c49a56d6d069 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.172455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f82489-88cd-45bd-bfbd-c49a56d6d069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.172614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f82489-88cd-45bd-bfbd-c49a56d6d069 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.173380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f82489-88cd-45bd-bfbd-c49a56d6d069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:17.173691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f82489-88cd-45bd-bfbd-c49a56d6d069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.175528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f82489-88cd-45bd-bfbd-c49a56d6d069 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.193034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1120/2257] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:17.198136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f82489-88cd-45bd-bfbd-c49a56d6d069 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.210902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f82489-88cd-45bd-bfbd-c49a56d6d069 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.217329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7f9d5-1dba-4536-b4f7-7082748f9626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.223086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7f9d5-1dba-4536-b4f7-7082748f9626 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.223086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7f9d5-1dba-4536-b4f7-7082748f9626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.223086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7f9d5-1dba-4536-b4f7-7082748f9626 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.223086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7f9d5-1dba-4536-b4f7-7082748f9626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.223458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1138/2258] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:17 2022] PUT /identity/v3/projects/d8e983852747461b8ca663cd6ff56ff4/users/022e761cfc694697b0ef9886025abc5e/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:17.223548 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7f9d5-1dba-4536-b4f7-7082748f9626 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.227231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451692-48ca-49ac-b82f-4c3368533a7a None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.228184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451692-48ca-49ac-b82f-4c3368533a7a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.228660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451692-48ca-49ac-b82f-4c3368533a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.257153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-42451692-48ca-49ac-b82f-4c3368533a7a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:17.261561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-42451692-48ca-49ac-b82f-4c3368533a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:17.351718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1139/2259] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:17.353213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606568-dff1-4337-badd-f9123aa76856 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.353506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606568-dff1-4337-badd-f9123aa76856 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.353904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606568-dff1-4337-badd-f9123aa76856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.357608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1121/2260] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:17 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:23:17.358659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7f9d5-1dba-4536-b4f7-7082748f9626 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.394298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-af606568-dff1-4337-badd-f9123aa76856 None None] MFA Rules not processed for user `e9e100eb0fdd4625be1a116e8bcf7576`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:17.395864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-af606568-dff1-4337-badd-f9123aa76856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:17.434999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7f9d5-1dba-4536-b4f7-7082748f9626 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.440840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e378003-4e45-4081-ad72-e2dfc7264ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.441552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378003-4e45-4081-ad72-e2dfc7264ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.441913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378003-4e45-4081-ad72-e2dfc7264ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.442266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e378003-4e45-4081-ad72-e2dfc7264ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.443046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e378003-4e45-4081-ad72-e2dfc7264ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.445205 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e378003-4e45-4081-ad72-e2dfc7264ed0 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.483568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1140/2261] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:17.484607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af606568-dff1-4337-badd-f9123aa76856 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.486118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-af606568-dff1-4337-badd-f9123aa76856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:17.540195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1122/2262] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:17 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:17.541367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e378003-4e45-4081-ad72-e2dfc7264ed0 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.543087 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2e378003-4e45-4081-ad72-e2dfc7264ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:17.556095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af606568-dff1-4337-badd-f9123aa76856 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.562417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe2c9a-93c7-446b-85e9-7ca3aaac43a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.562417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe2c9a-93c7-446b-85e9-7ca3aaac43a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.562417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe2c9a-93c7-446b-85e9-7ca3aaac43a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.562417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe2c9a-93c7-446b-85e9-7ca3aaac43a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.572737 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe2c9a-93c7-446b-85e9-7ca3aaac43a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.574345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe2c9a-93c7-446b-85e9-7ca3aaac43a4 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.585536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1141/2263] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:17.586576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe2c9a-93c7-446b-85e9-7ca3aaac43a4 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.597733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe2c9a-93c7-446b-85e9-7ca3aaac43a4 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.604361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4efc19-7491-49ba-b0d7-72c73cf07202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.605542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4efc19-7491-49ba-b0d7-72c73cf07202 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.605946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4efc19-7491-49ba-b0d7-72c73cf07202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.606817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4efc19-7491-49ba-b0d7-72c73cf07202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.607658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4efc19-7491-49ba-b0d7-72c73cf07202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.610080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4efc19-7491-49ba-b0d7-72c73cf07202 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.610727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e378003-4e45-4081-ad72-e2dfc7264ed0 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.615074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297de5d-cfe3-48e5-b800-c353ffdb16b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '979519f42f7d463bb2ee1d5b0bb72a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.615907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297de5d-cfe3-48e5-b800-c353ffdb16b7 service glance] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.616191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297de5d-cfe3-48e5-b800-c353ffdb16b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.616470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297de5d-cfe3-48e5-b800-c353ffdb16b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.619082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b297de5d-cfe3-48e5-b800-c353ffdb16b7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:17.626955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1142/2264] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:17.628157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4efc19-7491-49ba-b0d7-72c73cf07202 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.639587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4efc19-7491-49ba-b0d7-72c73cf07202 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.644514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934df51-73f4-4980-8f26-be21442e10b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.645218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934df51-73f4-4980-8f26-be21442e10b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.645503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934df51-73f4-4980-8f26-be21442e10b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.645782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934df51-73f4-4980-8f26-be21442e10b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.646567 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934df51-73f4-4980-8f26-be21442e10b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.648259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934df51-73f4-4980-8f26-be21442e10b2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.663025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1143/2265] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:23:17.664046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934df51-73f4-4980-8f26-be21442e10b2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.674911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934df51-73f4-4980-8f26-be21442e10b2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.679992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239869a5-d879-4b22-bff1-d975cf826548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.681082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239869a5-d879-4b22-bff1-d975cf826548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.681552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239869a5-d879-4b22-bff1-d975cf826548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.681912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239869a5-d879-4b22-bff1-d975cf826548 admin admin] PATH_INFO: `/v3/projects/8522fa2a30e440b890516e350e17de14/users/2113938dc6b94ec09e70771fdf570a85/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.687532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297de5d-cfe3-48e5-b800-c353ffdb16b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.689053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297de5d-cfe3-48e5-b800-c353ffdb16b7 service glance] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.701089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1123/2266] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:17.704533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239869a5-d879-4b22-bff1-d975cf826548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8522fa2a30e440b890516e350e17de14, user_id=2113938dc6b94ec09e70771fdf570a85, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.707334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239869a5-d879-4b22-bff1-d975cf826548 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.860350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1144/2267] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:17 2022] PUT /identity/v3/projects/8522fa2a30e440b890516e350e17de14/users/2113938dc6b94ec09e70771fdf570a85/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:17.865425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b92607-fbac-4d7a-8e9e-6a492b6b1762 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.865946 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b92607-fbac-4d7a-8e9e-6a492b6b1762 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.875319 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b92607-fbac-4d7a-8e9e-6a492b6b1762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.894516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-77b92607-fbac-4d7a-8e9e-6a492b6b1762 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:17.894516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-77b92607-fbac-4d7a-8e9e-6a492b6b1762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:17.972523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1124/2268] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:17.982291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239869a5-d879-4b22-bff1-d975cf826548 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.984090 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-239869a5-d879-4b22-bff1-d975cf826548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:18.077458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788350b-4619-4067-ac5e-a30e41616bdb None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:18.078083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788350b-4619-4067-ac5e-a30e41616bdb None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:18.078638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788350b-4619-4067-ac5e-a30e41616bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:18.085631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239869a5-d879-4b22-bff1-d975cf826548 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:18.093169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380e93-4801-42a6-bf9b-bc59c0381122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:18.093873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380e93-4801-42a6-bf9b-bc59c0381122 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:18.094164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380e93-4801-42a6-bf9b-bc59c0381122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:18.094441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380e93-4801-42a6-bf9b-bc59c0381122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:18.114500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee380e93-4801-42a6-bf9b-bc59c0381122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:18.116381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee380e93-4801-42a6-bf9b-bc59c0381122 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:18.135739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1145/2269] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:18.139275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-5788350b-4619-4067-ac5e-a30e41616bdb None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:18.141573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5788350b-4619-4067-ac5e-a30e41616bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:18.221346 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:18.270219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1125/2270] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:23:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:23:18.295487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380e93-4801-42a6-bf9b-bc59c0381122 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:18.297487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ee380e93-4801-42a6-bf9b-bc59c0381122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:18.432025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380e93-4801-42a6-bf9b-bc59c0381122 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:18.438021 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c651-3cee-4be1-a3c0-da0373b72a3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:18.438688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c651-3cee-4be1-a3c0-da0373b72a3b service swift] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:18.438973 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c651-3cee-4be1-a3c0-da0373b72a3b service swift] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:18.439250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c651-3cee-4be1-a3c0-da0373b72a3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:18.448239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089c651-3cee-4be1-a3c0-da0373b72a3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:18.451262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089c651-3cee-4be1-a3c0-da0373b72a3b service swift] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:18.461050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1146/2271] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:23:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:23:19.408645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:19.898309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788350b-4619-4067-ac5e-a30e41616bdb None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:19.900485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5788350b-4619-4067-ac5e-a30e41616bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:19.976412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4c110-c223-4ea8-b233-03fe2286d721 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.976937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4c110-c223-4ea8-b233-03fe2286d721 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.977593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4c110-c223-4ea8-b233-03fe2286d721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.015010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-edc4c110-c223-4ea8-b233-03fe2286d721 None None] MFA Rules not processed for user `022e761cfc694697b0ef9886025abc5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:20.016433 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-edc4c110-c223-4ea8-b233-03fe2286d721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:20.107345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1147/2272] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:20.115251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4c110-c223-4ea8-b233-03fe2286d721 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.117010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-edc4c110-c223-4ea8-b233-03fe2286d721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:20.187029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788350b-4619-4067-ac5e-a30e41616bdb None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.200687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6f1c-55d5-4e5d-9a8b-15f47d30d8c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.202427 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6f1c-55d5-4e5d-9a8b-15f47d30d8c5 service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.204240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6f1c-55d5-4e5d-9a8b-15f47d30d8c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.206394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6f1c-55d5-4e5d-9a8b-15f47d30d8c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.212955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d8cc6f1c-55d5-4e5d-9a8b-15f47d30d8c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:20.237689 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc6f1c-55d5-4e5d-9a8b-15f47d30d8c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.239610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc6f1c-55d5-4e5d-9a8b-15f47d30d8c5 service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.254586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4c110-c223-4ea8-b233-03fe2286d721 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.266549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf7d44-93ca-484b-b61a-efa6c42ccf86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.267337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf7d44-93ca-484b-b61a-efa6c42ccf86 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.267728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf7d44-93ca-484b-b61a-efa6c42ccf86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.268142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf7d44-93ca-484b-b61a-efa6c42ccf86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.273358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1126/2273] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:20.290568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf7d44-93ca-484b-b61a-efa6c42ccf86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.294547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf7d44-93ca-484b-b61a-efa6c42ccf86 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.319799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1148/2274] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:23:20.431642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:20.750335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acad3-73ad-48b4-b4cd-f652cddf8fba None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.750335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acad3-73ad-48b4-b4cd-f652cddf8fba None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.750671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acad3-73ad-48b4-b4cd-f652cddf8fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.830003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-7b2acad3-73ad-48b4-b4cd-f652cddf8fba None None] MFA Rules not processed for user `2113938dc6b94ec09e70771fdf570a85`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:20.830003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7b2acad3-73ad-48b4-b4cd-f652cddf8fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:20.962231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1127/2275] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:20.974231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf7d44-93ca-484b-b61a-efa6c42ccf86 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.975804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ebaf7d44-93ca-484b-b61a-efa6c42ccf86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:20.988126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf7d44-93ca-484b-b61a-efa6c42ccf86 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.998460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296e9f1-6846-4f94-ac17-5d4808dbc14d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.998460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296e9f1-6846-4f94-ac17-5d4808dbc14d service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.998460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296e9f1-6846-4f94-ac17-5d4808dbc14d service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.998460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296e9f1-6846-4f94-ac17-5d4808dbc14d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.006695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296e9f1-6846-4f94-ac17-5d4808dbc14d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.008525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296e9f1-6846-4f94-ac17-5d4808dbc14d service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.019900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1149/2276] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:22.047453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:23.421803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f60d6-4d4b-43c3-b31d-6bac8127edc8 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.422306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f60d6-4d4b-43c3-b31d-6bac8127edc8 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.422596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f60d6-4d4b-43c3-b31d-6bac8127edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.441183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a50f60d6-4d4b-43c3-b31d-6bac8127edc8 None None] MFA Rules not processed for user `022e761cfc694697b0ef9886025abc5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:23.442426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a50f60d6-4d4b-43c3-b31d-6bac8127edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:23.455739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1128/2277] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:23.493466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:24.423259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4ee4-8ea1-4faa-8351-a9b020ea3b70 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:24.423862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4ee4-8ea1-4faa-8351-a9b020ea3b70 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:24.423986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4ee4-8ea1-4faa-8351-a9b020ea3b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:24.480695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-bcbf4ee4-8ea1-4faa-8351-a9b020ea3b70 None None] MFA Rules not processed for user `2113938dc6b94ec09e70771fdf570a85`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:24.480695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-bcbf4ee4-8ea1-4faa-8351-a9b020ea3b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:24.494984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1150/2278] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:24.633383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:24.791130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f60d6-4d4b-43c3-b31d-6bac8127edc8 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:24.792705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a50f60d6-4d4b-43c3-b31d-6bac8127edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:24.816906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f60d6-4d4b-43c3-b31d-6bac8127edc8 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:24.823407 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:24.825235 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:24.825740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:24.826239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] PATH_INFO: `/v3/users/b4f6d82897df4c9bb85b10f53e79100a` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:24.827700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f6d82897df4c9bb85b10f53e79100a)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:24.830417 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:25.113920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f6d82897df4c9bb85b10f53e79100a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:25.179699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f6d82897df4c9bb85b10f53e79100a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:25.196451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f6d82897df4c9bb85b10f53e79100a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:25.197425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f6d82897df4c9bb85b10f53e79100a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:25.207860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f6d82897df4c9bb85b10f53e79100a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:25.215215 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1129/2279] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:24 2022] DELETE /identity/v3/users/b4f6d82897df4c9bb85b10f53e79100a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:25.222670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d920248-04c7-4b93-9604-53c44e97e5b4 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:25.223509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d920248-04c7-4b93-9604-53c44e97e5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:25.223792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d920248-04c7-4b93-9604-53c44e97e5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:25.232385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:25.256769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-1d920248-04c7-4b93-9604-53c44e97e5b4 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:25.258410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1d920248-04c7-4b93-9604-53c44e97e5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:25.373956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1151/2280] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:25.383858 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:25.386378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:25.499469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2c06e-c4f7-4e91-a0a8-3b687d4f1404 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:25.505945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9884d06-d076-4f2a-bb4a-f16c0d4d49bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:25.506660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9884d06-d076-4f2a-bb4a-f16c0d4d49bc service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:25.506886 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9884d06-d076-4f2a-bb4a-f16c0d4d49bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:25.507235 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9884d06-d076-4f2a-bb4a-f16c0d4d49bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:25.523783 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9884d06-d076-4f2a-bb4a-f16c0d4d49bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:25.526336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9884d06-d076-4f2a-bb4a-f16c0d4d49bc service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:25.540529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1130/2281] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:25.780003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.135213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d920248-04c7-4b93-9604-53c44e97e5b4 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.137026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1d920248-04c7-4b93-9604-53c44e97e5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:26.173634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d920248-04c7-4b93-9604-53c44e97e5b4 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.180317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.181665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.182155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.182789 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] PATH_INFO: `/v3/projects/baedcc2ca99b4a769e1d47f08128cee6` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.194488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baedcc2ca99b4a769e1d47f08128cee6)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:26.194488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:26.323636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baedcc2ca99b4a769e1d47f08128cee6', 'request_id': 'req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:26.336048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baedcc2ca99b4a769e1d47f08128cee6', 'request_id': 'req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:26.340368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.441552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baedcc2ca99b4a769e1d47f08128cee6', 'request_id': 'req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:26.467741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] The token cache is being invalidate because project baedcc2ca99b4a769e1d47f08128cee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:26.468446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:26.469368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2aa2f2cd-66f2-4f45-a2af-5716e6c38351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:26.471669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1152/2282] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:26 2022] DELETE /identity/v3/projects/baedcc2ca99b4a769e1d47f08128cee6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:26.476694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae982-1777-4e9a-ba7b-072562f0b83c None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.477218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae982-1777-4e9a-ba7b-072562f0b83c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.477671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae982-1777-4e9a-ba7b-072562f0b83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.514154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-233ae982-1777-4e9a-ba7b-072562f0b83c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:26.516107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-233ae982-1777-4e9a-ba7b-072562f0b83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:26.598054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1131/2283] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:26.606037 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423336-7cea-4f54-8bc5-2a397d103b21 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.606630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423336-7cea-4f54-8bc5-2a397d103b21 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.607189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423336-7cea-4f54-8bc5-2a397d103b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.610401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.634465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a3423336-7cea-4f54-8bc5-2a397d103b21 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:26.635795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a3423336-7cea-4f54-8bc5-2a397d103b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:26.655363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1153/2284] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:26.659843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae982-1777-4e9a-ba7b-072562f0b83c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.681680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae982-1777-4e9a-ba7b-072562f0b83c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.700661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9be88-4b41-4c7f-b8eb-5f0d486cff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.700661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9be88-4b41-4c7f-b8eb-5f0d486cff07 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.700661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9be88-4b41-4c7f-b8eb-5f0d486cff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.700661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9be88-4b41-4c7f-b8eb-5f0d486cff07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.701153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9be88-4b41-4c7f-b8eb-5f0d486cff07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:26.701153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9be88-4b41-4c7f-b8eb-5f0d486cff07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:26.701153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9be88-4b41-4c7f-b8eb-5f0d486cff07 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:26.710803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423336-7cea-4f54-8bc5-2a397d103b21 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.715542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1132/2285] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:26.721214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423336-7cea-4f54-8bc5-2a397d103b21 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.726548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84fdb7-d211-40e5-b98c-4ef1272b46be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.727600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84fdb7-d211-40e5-b98c-4ef1272b46be admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.728083 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84fdb7-d211-40e5-b98c-4ef1272b46be admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.728430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84fdb7-d211-40e5-b98c-4ef1272b46be admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.729216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84fdb7-d211-40e5-b98c-4ef1272b46be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:26.731836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84fdb7-d211-40e5-b98c-4ef1272b46be admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.283657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1154/2286] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:26 2022] POST /identity/v3/projects => generated 387 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:27.287864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9be88-4b41-4c7f-b8eb-5f0d486cff07 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.298436 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9be88-4b41-4c7f-b8eb-5f0d486cff07 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.360922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65921073-edfc-42b9-b05e-33d389b9ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.361763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65921073-edfc-42b9-b05e-33d389b9ae9e admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.362117 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65921073-edfc-42b9-b05e-33d389b9ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.362531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65921073-edfc-42b9-b05e-33d389b9ae9e admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.364105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65921073-edfc-42b9-b05e-33d389b9ae9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.366162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65921073-edfc-42b9-b05e-33d389b9ae9e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.467992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1133/2287] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:27 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:27.471756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84fdb7-d211-40e5-b98c-4ef1272b46be admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.499701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84fdb7-d211-40e5-b98c-4ef1272b46be admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.510642 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436881cc-b83c-49e7-97a5-0448c62737d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.512521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436881cc-b83c-49e7-97a5-0448c62737d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.513324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436881cc-b83c-49e7-97a5-0448c62737d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.514106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436881cc-b83c-49e7-97a5-0448c62737d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.534222 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436881cc-b83c-49e7-97a5-0448c62737d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.539593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436881cc-b83c-49e7-97a5-0448c62737d1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.596194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1155/2288] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:27.597362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65921073-edfc-42b9-b05e-33d389b9ae9e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.614290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65921073-edfc-42b9-b05e-33d389b9ae9e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.632988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc560e43-1447-4c76-a89b-d8e90d725296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.633762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc560e43-1447-4c76-a89b-d8e90d725296 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.636888 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc560e43-1447-4c76-a89b-d8e90d725296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.636888 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc560e43-1447-4c76-a89b-d8e90d725296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.638988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc560e43-1447-4c76-a89b-d8e90d725296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.643744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc560e43-1447-4c76-a89b-d8e90d725296 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.648930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:27.672497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1134/2289] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:27.678121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436881cc-b83c-49e7-97a5-0448c62737d1 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.688536 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:27.706081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436881cc-b83c-49e7-97a5-0448c62737d1 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.716538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4076b-aa0c-49fa-bda1-7193a790aa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.717602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4076b-aa0c-49fa-bda1-7193a790aa20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.717893 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4076b-aa0c-49fa-bda1-7193a790aa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.718177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4076b-aa0c-49fa-bda1-7193a790aa20 admin admin] PATH_INFO: `/v3/projects/02aa70a521204291b62be4219f480f35/users/b84854d1ec274690b3dcf019171b0ab3/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.737165 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4076b-aa0c-49fa-bda1-7193a790aa20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02aa70a521204291b62be4219f480f35, user_id=b84854d1ec274690b3dcf019171b0ab3, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.739818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4076b-aa0c-49fa-bda1-7193a790aa20 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.835500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1156/2290] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:27 2022] PUT /identity/v3/projects/02aa70a521204291b62be4219f480f35/users/b84854d1ec274690b3dcf019171b0ab3/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:27.847789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff1e7-3fe1-4714-92e8-44cee4568617 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.848184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff1e7-3fe1-4714-92e8-44cee4568617 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.848399 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff1e7-3fe1-4714-92e8-44cee4568617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.914480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-73bff1e7-3fe1-4714-92e8-44cee4568617 None None] MFA Rules not processed for user `b84854d1ec274690b3dcf019171b0ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:27.915832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-73bff1e7-3fe1-4714-92e8-44cee4568617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:27.940565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:28.033253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1135/2291] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:28.042313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4076b-aa0c-49fa-bda1-7193a790aa20 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:28.056475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c1e4076b-aa0c-49fa-bda1-7193a790aa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:28.099506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:28.117977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:28.151954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4076b-aa0c-49fa-bda1-7193a790aa20 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:28.158091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fd9a6-986c-497c-aa41-dd8a1e4abe26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:28.158852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fd9a6-986c-497c-aa41-dd8a1e4abe26 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.159165 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fd9a6-986c-497c-aa41-dd8a1e4abe26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.159510 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fd9a6-986c-497c-aa41-dd8a1e4abe26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.176425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fd9a6-986c-497c-aa41-dd8a1e4abe26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:28.177987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fd9a6-986c-497c-aa41-dd8a1e4abe26 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:28.189350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1157/2292] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:29.048597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:33.446065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6abeb-4106-4042-ae11-800792cfc0cb None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.446692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6abeb-4106-4042-ae11-800792cfc0cb None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.446692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6abeb-4106-4042-ae11-800792cfc0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.467228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c7d6abeb-4106-4042-ae11-800792cfc0cb None None] MFA Rules not processed for user `fac722ebafd540b0b3fe05d83fa39c36`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:33.468471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c7d6abeb-4106-4042-ae11-800792cfc0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:33.523803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1136/2293] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:38.991451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=14 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:43.517126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=34 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:50.757377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fd9a6-986c-497c-aa41-dd8a1e4abe26 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:50.758824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ef9fd9a6-986c-497c-aa41-dd8a1e4abe26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:50.828420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fd9a6-986c-497c-aa41-dd8a1e4abe26 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:50.835498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:50.835799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:50.836141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:50.836419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] PATH_INFO: `/v3/users/4332b805b09b4f58a11c019eade6fa90` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:50.837969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4332b805b09b4f58a11c019eade6fa90)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:50.839956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:51.057710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4332b805b09b4f58a11c019eade6fa90'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:51.128257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4332b805b09b4f58a11c019eade6fa90'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:51.150303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4332b805b09b4f58a11c019eade6fa90'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:51.150303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4332b805b09b4f58a11c019eade6fa90'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:51.159129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4332b805b09b4f58a11c019eade6fa90'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:51.169701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1158/2294] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:50 2022] DELETE /identity/v3/users/4332b805b09b4f58a11c019eade6fa90 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:51.173829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba4ea3-11f0-43d7-a1e4-10e1cc202147 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:51.174353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba4ea3-11f0-43d7-a1e4-10e1cc202147 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:51.174454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba4ea3-11f0-43d7-a1e4-10e1cc202147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:51.197166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-fcba4ea3-11f0-43d7-a1e4-10e1cc202147 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:51.199919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fcba4ea3-11f0-43d7-a1e4-10e1cc202147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:51.288315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1137/2295] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:51.302431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:51.304065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:51.388222 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfb4dd-4b16-4ade-8dba-2b34e679a1e2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:51.396825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172036be-ba98-4520-b082-2433b80f001a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:51.396825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172036be-ba98-4520-b082-2433b80f001a service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:51.396825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172036be-ba98-4520-b082-2433b80f001a service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:51.396825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172036be-ba98-4520-b082-2433b80f001a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:51.408241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172036be-ba98-4520-b082-2433b80f001a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:51.409699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172036be-ba98-4520-b082-2433b80f001a service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:51.421095 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1159/2296] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:52.030435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba4ea3-11f0-43d7-a1e4-10e1cc202147 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.030435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fcba4ea3-11f0-43d7-a1e4-10e1cc202147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:52.042488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba4ea3-11f0-43d7-a1e4-10e1cc202147 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.047428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.048609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.048980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.054426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] PATH_INFO: `/v3/projects/62790eb30c9d4a7692891ea901f02819` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.054426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62790eb30c9d4a7692891ea901f02819)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.054426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.174697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62790eb30c9d4a7692891ea901f02819', 'request_id': 'req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:52.180989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62790eb30c9d4a7692891ea901f02819', 'request_id': 'req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:52.305776 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62790eb30c9d4a7692891ea901f02819', 'request_id': 'req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:52.318155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] The token cache is being invalidate because project 62790eb30c9d4a7692891ea901f02819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:23:52.318504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:52.319279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-cfb890df-be8e-47f1-9a0c-1a35c25c6f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:52.324060 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1138/2297] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:52 2022] DELETE /identity/v3/projects/62790eb30c9d4a7692891ea901f02819 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:52.326070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae39fc-7927-4f5d-9e29-bbd094c69e55 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.326572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae39fc-7927-4f5d-9e29-bbd094c69e55 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.326665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae39fc-7927-4f5d-9e29-bbd094c69e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.344521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0eae39fc-7927-4f5d-9e29-bbd094c69e55 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:52.345698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0eae39fc-7927-4f5d-9e29-bbd094c69e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:52.363338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:52.409572 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1160/2298] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:52.417435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b459e9-c2b6-491b-8807-f6b4b95f7580 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.417734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b459e9-c2b6-491b-8807-f6b4b95f7580 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.418023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b459e9-c2b6-491b-8807-f6b4b95f7580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.437653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-80b459e9-c2b6-491b-8807-f6b4b95f7580 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:52.438885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-80b459e9-c2b6-491b-8807-f6b4b95f7580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:52.447026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1139/2299] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:52.451294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae39fc-7927-4f5d-9e29-bbd094c69e55 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.461119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae39fc-7927-4f5d-9e29-bbd094c69e55 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.466274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc7add-a627-4709-84ea-695d376b834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.467286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7add-a627-4709-84ea-695d376b834a admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.467286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7add-a627-4709-84ea-695d376b834a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.467541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc7add-a627-4709-84ea-695d376b834a admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.468311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc7add-a627-4709-84ea-695d376b834a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:52.468621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc7add-a627-4709-84ea-695d376b834a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.470228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc7add-a627-4709-84ea-695d376b834a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.486379 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1161/2300] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:52.487893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b459e9-c2b6-491b-8807-f6b4b95f7580 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.497985 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b459e9-c2b6-491b-8807-f6b4b95f7580 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.502847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe2e84-a185-4efd-af46-8522bef3e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.503527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2e84-a185-4efd-af46-8522bef3e8aa admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.503818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2e84-a185-4efd-af46-8522bef3e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.504131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2e84-a185-4efd-af46-8522bef3e8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.504837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe2e84-a185-4efd-af46-8522bef3e8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.506777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe2e84-a185-4efd-af46-8522bef3e8aa admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.602549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1140/2301] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:23:52 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:52.607218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc7add-a627-4709-84ea-695d376b834a admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.618504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc7add-a627-4709-84ea-695d376b834a admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.682043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870a68-8096-4530-8e24-1bab982e4a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.682729 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870a68-8096-4530-8e24-1bab982e4a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.683004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870a68-8096-4530-8e24-1bab982e4a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.683274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870a68-8096-4530-8e24-1bab982e4a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.684026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e870a68-8096-4530-8e24-1bab982e4a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.685952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e870a68-8096-4530-8e24-1bab982e4a78 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.768129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1162/2302] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:23:52 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:52.772184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe2e84-a185-4efd-af46-8522bef3e8aa admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.782947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe2e84-a185-4efd-af46-8522bef3e8aa admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.787565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9239cf-78cc-4363-b225-c2c3ede1dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.788372 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9239cf-78cc-4363-b225-c2c3ede1dd60 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.788702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9239cf-78cc-4363-b225-c2c3ede1dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.788981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9239cf-78cc-4363-b225-c2c3ede1dd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.789705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9239cf-78cc-4363-b225-c2c3ede1dd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.791307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9239cf-78cc-4363-b225-c2c3ede1dd60 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.802837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1141/2303] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:52.806920 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870a68-8096-4530-8e24-1bab982e4a78 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.817385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870a68-8096-4530-8e24-1bab982e4a78 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.822171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f54b0-31ae-47d9-9265-1cf5c3974de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.822856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f54b0-31ae-47d9-9265-1cf5c3974de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.823144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f54b0-31ae-47d9-9265-1cf5c3974de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.823422 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f54b0-31ae-47d9-9265-1cf5c3974de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.824192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f54b0-31ae-47d9-9265-1cf5c3974de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.825807 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f54b0-31ae-47d9-9265-1cf5c3974de1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.836515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1163/2304] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:52.841697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9239cf-78cc-4363-b225-c2c3ede1dd60 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.851952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9239cf-78cc-4363-b225-c2c3ede1dd60 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.857348 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1477a-0450-4227-9718-faca0bc12832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.858247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1477a-0450-4227-9718-faca0bc12832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.858595 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1477a-0450-4227-9718-faca0bc12832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.858931 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1477a-0450-4227-9718-faca0bc12832 admin admin] PATH_INFO: `/v3/projects/f8f3769c59d942b4b8b1050ecc05ca76/users/61f797950f4a414587830397d9bdfe3c/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.874395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1477a-0450-4227-9718-faca0bc12832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f3769c59d942b4b8b1050ecc05ca76, user_id=61f797950f4a414587830397d9bdfe3c, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.877195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1477a-0450-4227-9718-faca0bc12832 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.976074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1142/2305] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:23:52 2022] PUT /identity/v3/projects/f8f3769c59d942b4b8b1050ecc05ca76/users/61f797950f4a414587830397d9bdfe3c/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:52.986691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f737-1d51-44d0-b420-ddab8d5306a8 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.986984 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f737-1d51-44d0-b420-ddab8d5306a8 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.987267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f737-1d51-44d0-b420-ddab8d5306a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:53.016890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-b348f737-1d51-44d0-b420-ddab8d5306a8 None None] MFA Rules not processed for user `61f797950f4a414587830397d9bdfe3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:53.018241 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b348f737-1d51-44d0-b420-ddab8d5306a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:53.103633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1164/2306] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:23:53.111143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1477a-0450-4227-9718-faca0bc12832 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:53.112863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f9b1477a-0450-4227-9718-faca0bc12832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:53.137085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:53.203949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1477a-0450-4227-9718-faca0bc12832 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:53.213543 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa4930-514d-4231-a722-49f8631136a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:53.214335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa4930-514d-4231-a722-49f8631136a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:53.214844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa4930-514d-4231-a722-49f8631136a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:53.216336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa4930-514d-4231-a722-49f8631136a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:53.225899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa4930-514d-4231-a722-49f8631136a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:53.227397 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa4930-514d-4231-a722-49f8631136a2 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:53.238256 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1143/2307] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:54.853912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337842d0-8202-4425-bc85-5b61e2a148fe None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:54.854406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337842d0-8202-4425-bc85-5b61e2a148fe None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:54.854504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337842d0-8202-4425-bc85-5b61e2a148fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:54.872956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-337842d0-8202-4425-bc85-5b61e2a148fe None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:54.874168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-337842d0-8202-4425-bc85-5b61e2a148fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:54.886790 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:54.935337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1165/2308] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:23:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:54.960449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa4930-514d-4231-a722-49f8631136a2 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:54.962031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-80aa4930-514d-4231-a722-49f8631136a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:55.054294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa4930-514d-4231-a722-49f8631136a2 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:55.075090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2d768-f004-4321-a598-cac4dfac5f1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:55.076501 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2d768-f004-4321-a598-cac4dfac5f1b service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.076857 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2d768-f004-4321-a598-cac4dfac5f1b service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.077244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2d768-f004-4321-a598-cac4dfac5f1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.088928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2d768-f004-4321-a598-cac4dfac5f1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:55.091317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2d768-f004-4321-a598-cac4dfac5f1b service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:55.102632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1144/2309] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:23:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:23:57.775691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337842d0-8202-4425-bc85-5b61e2a148fe None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:57.777263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-337842d0-8202-4425-bc85-5b61e2a148fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:57.874027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337842d0-8202-4425-bc85-5b61e2a148fe None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:57.879523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:57.880440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:57.880723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:57.880997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] PATH_INFO: `/v3/users/b84854d1ec274690b3dcf019171b0ab3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:57.882223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84854d1ec274690b3dcf019171b0ab3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:57.885844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:58.144740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84854d1ec274690b3dcf019171b0ab3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:58.248101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84854d1ec274690b3dcf019171b0ab3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:58.262421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84854d1ec274690b3dcf019171b0ab3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:58.263264 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84854d1ec274690b3dcf019171b0ab3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:58.273834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84854d1ec274690b3dcf019171b0ab3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:58.280494 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1166/2310] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:57 2022] DELETE /identity/v3/users/b84854d1ec274690b3dcf019171b0ab3 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:58.285327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded035fa-4230-4ac8-8aef-dbb67d540e58 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:58.285900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded035fa-4230-4ac8-8aef-dbb67d540e58 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:58.288254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded035fa-4230-4ac8-8aef-dbb67d540e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:58.321011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-ded035fa-4230-4ac8-8aef-dbb67d540e58 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:58.322403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ded035fa-4230-4ac8-8aef-dbb67d540e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:58.399966 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1145/2311] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:23:58.411350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:58.413269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:58.468999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:58.482097 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1cc6c-5973-4662-ae73-6d661d67e065 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:58.486348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265086d7-794a-4e97-939b-12ecda9732fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:58.487069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265086d7-794a-4e97-939b-12ecda9732fa service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:58.487358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265086d7-794a-4e97-939b-12ecda9732fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:58.487640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265086d7-794a-4e97-939b-12ecda9732fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:58.501903 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265086d7-794a-4e97-939b-12ecda9732fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:58.502239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265086d7-794a-4e97-939b-12ecda9732fa service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:58.517586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1167/2312] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:58.749253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded035fa-4230-4ac8-8aef-dbb67d540e58 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:58.751335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ded035fa-4230-4ac8-8aef-dbb67d540e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:58.783794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded035fa-4230-4ac8-8aef-dbb67d540e58 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:58.799584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:58.802076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:58.802607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:58.806034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] PATH_INFO: `/v3/users/61f797950f4a414587830397d9bdfe3c` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:58.807901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f797950f4a414587830397d9bdfe3c)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:58.811531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:59.480507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f797950f4a414587830397d9bdfe3c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:59.483713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:59.550456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f797950f4a414587830397d9bdfe3c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:59.564781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f797950f4a414587830397d9bdfe3c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:59.565658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f797950f4a414587830397d9bdfe3c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:59.581801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f797950f4a414587830397d9bdfe3c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:59.597068 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1146/2313] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:23:58 2022] DELETE /identity/v3/users/61f797950f4a414587830397d9bdfe3c => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:59.606260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2af7-9f11-4ee6-aa0e-5e4f0fe16e44 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.606260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2af7-9f11-4ee6-aa0e-5e4f0fe16e44 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.607399 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2af7-9f11-4ee6-aa0e-5e4f0fe16e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.625934 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-85eb2af7-9f11-4ee6-aa0e-5e4f0fe16e44 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:59.627202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-85eb2af7-9f11-4ee6-aa0e-5e4f0fe16e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:59.694936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1168/2314] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:23:59.708304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:59.710515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:59.737400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb2af7-9f11-4ee6-aa0e-5e4f0fe16e44 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:59.742110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-85eb2af7-9f11-4ee6-aa0e-5e4f0fe16e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:59.764850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb2af7-9f11-4ee6-aa0e-5e4f0fe16e44 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:59.793338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:59.794964 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.795358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.795658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] PATH_INFO: `/v3/projects/02aa70a521204291b62be4219f480f35` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.797951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02aa70a521204291b62be4219f480f35)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:59.800511 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:59.817724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d2745-74d7-4ee4-ab09-b2f237f9fef7 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:59.835197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5be372-d235-4887-aa8c-7d88756ee115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:59.836096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5be372-d235-4887-aa8c-7d88756ee115 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.836391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5be372-d235-4887-aa8c-7d88756ee115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.836782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5be372-d235-4887-aa8c-7d88756ee115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.868067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5be372-d235-4887-aa8c-7d88756ee115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:59.868067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5be372-d235-4887-aa8c-7d88756ee115 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:59.879015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1147/2315] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:23:59.966454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02aa70a521204291b62be4219f480f35', 'request_id': 'req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:23:59.973991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02aa70a521204291b62be4219f480f35', 'request_id': 'req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:00.054177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02aa70a521204291b62be4219f480f35', 'request_id': 'req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:00.070216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] The token cache is being invalidate because project 02aa70a521204291b62be4219f480f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:24:00.071086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:00.072025 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-da5f8100-47b2-4ff9-9a5f-7ac549fa60c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:00.079964 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1169/2316] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:23:59 2022] DELETE /identity/v3/projects/02aa70a521204291b62be4219f480f35 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:24:00.703247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5be372-d235-4887-aa8c-7d88756ee115 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:00.704830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-eb5be372-d235-4887-aa8c-7d88756ee115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:00.721057 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5be372-d235-4887-aa8c-7d88756ee115 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:00.805338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:00.806955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:00.807550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:00.807938 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] PATH_INFO: `/v3/projects/f8f3769c59d942b4b8b1050ecc05ca76` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:00.809630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f3769c59d942b4b8b1050ecc05ca76)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:00.812201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:00.935241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f3769c59d942b4b8b1050ecc05ca76', 'request_id': 'req-4f16b713-2d87-42e0-9243-05786b0e79c1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:00.941573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f3769c59d942b4b8b1050ecc05ca76', 'request_id': 'req-4f16b713-2d87-42e0-9243-05786b0e79c1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:01.036823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f3769c59d942b4b8b1050ecc05ca76', 'request_id': 'req-4f16b713-2d87-42e0-9243-05786b0e79c1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:01.044562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:01.049819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] The token cache is being invalidate because project f8f3769c59d942b4b8b1050ecc05ca76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:24:01.050160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:01.051014 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f16b713-2d87-42e0-9243-05786b0e79c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:01.059616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b606bb-3ebf-4a12-b5bb-4ca9ee0453ee None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.060202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b606bb-3ebf-4a12-b5bb-4ca9ee0453ee None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.060326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b606bb-3ebf-4a12-b5bb-4ca9ee0453ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.061762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1148/2317] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:24:00 2022] DELETE /identity/v3/projects/f8f3769c59d942b4b8b1050ecc05ca76 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:24:01.080499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-45b606bb-3ebf-4a12-b5bb-4ca9ee0453ee None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:01.081717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-45b606bb-3ebf-4a12-b5bb-4ca9ee0453ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:01.159688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1170/2318] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:24:01.230812 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161929e8-45f7-460e-b9e9-b5343bc9ba38 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.231618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161929e8-45f7-460e-b9e9-b5343bc9ba38 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.231859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161929e8-45f7-460e-b9e9-b5343bc9ba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.262907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-161929e8-45f7-460e-b9e9-b5343bc9ba38 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:01.272122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-161929e8-45f7-460e-b9e9-b5343bc9ba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:01.283318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b606bb-3ebf-4a12-b5bb-4ca9ee0453ee None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.283866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1149/2319] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:24:01.297905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b606bb-3ebf-4a12-b5bb-4ca9ee0453ee None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.302922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b21cba-be83-473d-97a3-e8474bd8b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.303612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b21cba-be83-473d-97a3-e8474bd8b10b admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.303844 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b21cba-be83-473d-97a3-e8474bd8b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.304164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b21cba-be83-473d-97a3-e8474bd8b10b admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.304905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b21cba-be83-473d-97a3-e8474bd8b10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:01.305206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b21cba-be83-473d-97a3-e8474bd8b10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.307208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b21cba-be83-473d-97a3-e8474bd8b10b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.310513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:01.321694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1171/2320] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:01.327285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161929e8-45f7-460e-b9e9-b5343bc9ba38 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.338595 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161929e8-45f7-460e-b9e9-b5343bc9ba38 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.347952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aad84-2eaf-41fc-b980-97a489cd3e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.348762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aad84-2eaf-41fc-b980-97a489cd3e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.349129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aad84-2eaf-41fc-b980-97a489cd3e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.349420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aad84-2eaf-41fc-b980-97a489cd3e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.350166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3aad84-2eaf-41fc-b980-97a489cd3e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.352414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3aad84-2eaf-41fc-b980-97a489cd3e67 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.445628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1150/2321] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:24:01 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:01.449535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b21cba-be83-473d-97a3-e8474bd8b10b admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.460092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b21cba-be83-473d-97a3-e8474bd8b10b admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.538890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639683b-3c08-4a7e-8f0b-6c9e0c1bb266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.539521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639683b-3c08-4a7e-8f0b-6c9e0c1bb266 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.539970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639683b-3c08-4a7e-8f0b-6c9e0c1bb266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.540256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639683b-3c08-4a7e-8f0b-6c9e0c1bb266 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.540970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639683b-3c08-4a7e-8f0b-6c9e0c1bb266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.543089 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639683b-3c08-4a7e-8f0b-6c9e0c1bb266 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.684697 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1172/2322] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:24:01 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:01.688603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aad84-2eaf-41fc-b980-97a489cd3e67 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.700130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aad84-2eaf-41fc-b980-97a489cd3e67 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.709658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e72d8-662e-44b7-aa02-2625c1c90386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.710545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e72d8-662e-44b7-aa02-2625c1c90386 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.710645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e72d8-662e-44b7-aa02-2625c1c90386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.710887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e72d8-662e-44b7-aa02-2625c1c90386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.711622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e72d8-662e-44b7-aa02-2625c1c90386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.713619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e72d8-662e-44b7-aa02-2625c1c90386 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.725969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1151/2323] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:24:01.729969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639683b-3c08-4a7e-8f0b-6c9e0c1bb266 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.785768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639683b-3c08-4a7e-8f0b-6c9e0c1bb266 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.795290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ed8a0-b9a4-4167-9b41-e30a83b6f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.796524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed8a0-b9a4-4167-9b41-e30a83b6f87f admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.796811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed8a0-b9a4-4167-9b41-e30a83b6f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.797085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed8a0-b9a4-4167-9b41-e30a83b6f87f admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.798258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ed8a0-b9a4-4167-9b41-e30a83b6f87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.799867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ed8a0-b9a4-4167-9b41-e30a83b6f87f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.812052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1173/2324] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:24:01.817594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e72d8-662e-44b7-aa02-2625c1c90386 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.828873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e72d8-662e-44b7-aa02-2625c1c90386 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.834005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f0bf-0ff5-4c5b-ae45-6000ee96fa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.835045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f0bf-0ff5-4c5b-ae45-6000ee96fa4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.835404 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f0bf-0ff5-4c5b-ae45-6000ee96fa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.835768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f0bf-0ff5-4c5b-ae45-6000ee96fa4b admin admin] PATH_INFO: `/v3/projects/a45bda3f23894950a684e2173d899b5b/users/bc76373639de4aa9b5b4c6bca3f5c6ac/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.855724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181f0bf-0ff5-4c5b-ae45-6000ee96fa4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45bda3f23894950a684e2173d899b5b, user_id=bc76373639de4aa9b5b4c6bca3f5c6ac, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.859916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181f0bf-0ff5-4c5b-ae45-6000ee96fa4b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.976206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0aa7-3f5a-4965-8517-2a0e2c0270ff None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.976206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0aa7-3f5a-4965-8517-2a0e2c0270ff None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.976206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0aa7-3f5a-4965-8517-2a0e2c0270ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.976454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1152/2325] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:24:01 2022] PUT /identity/v3/projects/a45bda3f23894950a684e2173d899b5b/users/bc76373639de4aa9b5b4c6bca3f5c6ac/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:24:02.011545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-b0ff0aa7-3f5a-4965-8517-2a0e2c0270ff None None] MFA Rules not processed for user `bc76373639de4aa9b5b4c6bca3f5c6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:02.013355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b0ff0aa7-3f5a-4965-8517-2a0e2c0270ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:02.097267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1174/2326] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:24:02.108141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f0bf-0ff5-4c5b-ae45-6000ee96fa4b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:02.110063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2181f0bf-0ff5-4c5b-ae45-6000ee96fa4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:02.171837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f0bf-0ff5-4c5b-ae45-6000ee96fa4b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:02.175728 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88bf03-8c10-4ff7-8e03-c3bbabd53755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:02.181920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88bf03-8c10-4ff7-8e03-c3bbabd53755 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.181920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88bf03-8c10-4ff7-8e03-c3bbabd53755 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.181920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88bf03-8c10-4ff7-8e03-c3bbabd53755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.186621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88bf03-8c10-4ff7-8e03-c3bbabd53755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:02.188212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88bf03-8c10-4ff7-8e03-c3bbabd53755 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:02.198159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1153/2327] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:24:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:24:12.093918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:12.193444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:16.965679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0aa7-3f5a-4965-8517-2a0e2c0270ff None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:17.031644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0aa7-3f5a-4965-8517-2a0e2c0270ff None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:17.036608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:17.037451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.049173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.049173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] PATH_INFO: `/v3/users/bc76373639de4aa9b5b4c6bca3f5c6ac` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.049173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc76373639de4aa9b5b4c6bca3f5c6ac)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:17.049173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:17.318052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc76373639de4aa9b5b4c6bca3f5c6ac'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:17.414653 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc76373639de4aa9b5b4c6bca3f5c6ac'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:17.435482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc76373639de4aa9b5b4c6bca3f5c6ac'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:17.436373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc76373639de4aa9b5b4c6bca3f5c6ac'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:17.444770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc76373639de4aa9b5b4c6bca3f5c6ac'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:17.451286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1175/2328] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:24:16 2022] DELETE /identity/v3/users/bc76373639de4aa9b5b4c6bca3f5c6ac => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:24:17.455899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145815e1-f955-4441-8ae9-629df72ba8c9 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.456353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145815e1-f955-4441-8ae9-629df72ba8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.456548 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145815e1-f955-4441-8ae9-629df72ba8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.475766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-145815e1-f955-4441-8ae9-629df72ba8c9 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:17.477102 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-145815e1-f955-4441-8ae9-629df72ba8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:17.563549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1154/2329] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:24:17.573691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:17.575171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:17.637177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214470d-3c73-42fb-a838-c34c4fb725d2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:17.640935 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55bd28-ee78-4320-8277-1e482e24c401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:17.641605 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55bd28-ee78-4320-8277-1e482e24c401 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.641894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55bd28-ee78-4320-8277-1e482e24c401 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.642168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55bd28-ee78-4320-8277-1e482e24c401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.656656 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55bd28-ee78-4320-8277-1e482e24c401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:17.658273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55bd28-ee78-4320-8277-1e482e24c401 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:17.669218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1176/2330] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:24:18.241885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145815e1-f955-4441-8ae9-629df72ba8c9 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:18.243393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-145815e1-f955-4441-8ae9-629df72ba8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:18.256685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145815e1-f955-4441-8ae9-629df72ba8c9 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:18.263498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:18.263498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:18.263498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:18.263498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] PATH_INFO: `/v3/projects/a45bda3f23894950a684e2173d899b5b` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:18.266227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45bda3f23894950a684e2173d899b5b)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:18.268791 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:18.455227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45bda3f23894950a684e2173d899b5b', 'request_id': 'req-3edc3749-6857-4121-82d1-948017deb015'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:18.463611 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45bda3f23894950a684e2173d899b5b', 'request_id': 'req-3edc3749-6857-4121-82d1-948017deb015'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:18.573921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45bda3f23894950a684e2173d899b5b', 'request_id': 'req-3edc3749-6857-4121-82d1-948017deb015'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:18.588889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] The token cache is being invalidate because project a45bda3f23894950a684e2173d899b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:24:18.589545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:18.590849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:24:18.593489 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1155/2331] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:24:18 2022] DELETE /identity/v3/projects/a45bda3f23894950a684e2173d899b5b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:24:20.934190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6332ac7-8b37-4cdf-95f0-d7f25b134113 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.934770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6332ac7-8b37-4cdf-95f0-d7f25b134113 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.934770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6332ac7-8b37-4cdf-95f0-d7f25b134113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.952342 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-e6332ac7-8b37-4cdf-95f0-d7f25b134113 None None] MFA Rules not processed for user `022e761cfc694697b0ef9886025abc5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:20.953530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e6332ac7-8b37-4cdf-95f0-d7f25b134113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:20.970856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:21.011051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1177/2332] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:24:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:24:28.585122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:31.071023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=15 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:43.956605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:43.958273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:44.026765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc3749-6857-4121-82d1-948017deb015 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:44.031356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302081b-fc8a-45de-97a6-406c4a0d0d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:44.031993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302081b-fc8a-45de-97a6-406c4a0d0d3b service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:44.032282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302081b-fc8a-45de-97a6-406c4a0d0d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:44.032563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302081b-fc8a-45de-97a6-406c4a0d0d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:44.034433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6302081b-fc8a-45de-97a6-406c4a0d0d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:44.122395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302081b-fc8a-45de-97a6-406c4a0d0d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:44.124085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302081b-fc8a-45de-97a6-406c4a0d0d3b service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:44.134803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1156/2333] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:24:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:24:53.077740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66f2c9-af25-4fa6-9e11-821b6338a652 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:53.078277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66f2c9-af25-4fa6-9e11-821b6338a652 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:53.078277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66f2c9-af25-4fa6-9e11-821b6338a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:53.098133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7e66f2c9-af25-4fa6-9e11-821b6338a652 None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:53.099365 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7e66f2c9-af25-4fa6-9e11-821b6338a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:53.153766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1178/2334] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:24:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:24:53.166374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302081b-fc8a-45de-97a6-406c4a0d0d3b service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:53.167837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6302081b-fc8a-45de-97a6-406c4a0d0d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:53.246638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302081b-fc8a-45de-97a6-406c4a0d0d3b service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:53.252114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b800d-4590-4467-a834-09e3f2f64025 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:53.252770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b800d-4590-4467-a834-09e3f2f64025 service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:53.253051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b800d-4590-4467-a834-09e3f2f64025 service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:53.253327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b800d-4590-4467-a834-09e3f2f64025 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:53.261934 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b800d-4590-4467-a834-09e3f2f64025 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:53.265508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b800d-4590-4467-a834-09e3f2f64025 service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:53.273420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1157/2335] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:24:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:25:03.147080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=25 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:03.269699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=82 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:11.987992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1eb5d-85ee-4aee-ab61-54fb222231d3 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:11.988520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1eb5d-85ee-4aee-ab61-54fb222231d3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:11.988612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1eb5d-85ee-4aee-ab61-54fb222231d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:12.007042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f4c1eb5d-85ee-4aee-ab61-54fb222231d3 None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:12.009588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f4c1eb5d-85ee-4aee-ab61-54fb222231d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:12.015867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1179/2336] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:25:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:25:12.027958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b800d-4590-4467-a834-09e3f2f64025 service swift] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:12.038367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b800d-4590-4467-a834-09e3f2f64025 service swift] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:12.043340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48212e92-916c-4d2c-ab84-355f27c77041 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:12.043999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48212e92-916c-4d2c-ab84-355f27c77041 service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:12.044285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48212e92-916c-4d2c-ab84-355f27c77041 service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:12.045071 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48212e92-916c-4d2c-ab84-355f27c77041 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:12.056238 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48212e92-916c-4d2c-ab84-355f27c77041 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:12.057836 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48212e92-916c-4d2c-ab84-355f27c77041 service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:12.066640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1158/2337] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:25:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:25:12.256914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca5a7c-2ec3-4a93-ae85-67bf87799344 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:12.257295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca5a7c-2ec3-4a93-ae85-67bf87799344 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:12.257640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca5a7c-2ec3-4a93-ae85-67bf87799344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:12.276788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-c5ca5a7c-2ec3-4a93-ae85-67bf87799344 None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:12.278091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c5ca5a7c-2ec3-4a93-ae85-67bf87799344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:12.286142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1180/2338] 10.222.0.46 () {58 vars in 967 bytes} [Thu Jun 2 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:25:12.299901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48212e92-916c-4d2c-ab84-355f27c77041 service swift] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:12.311636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48212e92-916c-4d2c-ab84-355f27c77041 service swift] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:12.317977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca839056-18d3-4a68-942f-8a0398057aab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:12.318646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839056-18d3-4a68-942f-8a0398057aab service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:12.318935 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839056-18d3-4a68-942f-8a0398057aab service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:12.319220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839056-18d3-4a68-942f-8a0398057aab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:12.331228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca839056-18d3-4a68-942f-8a0398057aab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:12.332903 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca839056-18d3-4a68-942f-8a0398057aab service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:12.343059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1159/2339] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:25:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:25:16.339863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca5a7c-2ec3-4a93-ae85-67bf87799344 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:16.350582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca5a7c-2ec3-4a93-ae85-67bf87799344 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:16.354143 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deea8d-7bdc-493e-b553-81b3a6c7e6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:16.354811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deea8d-7bdc-493e-b553-81b3a6c7e6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:16.355169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deea8d-7bdc-493e-b553-81b3a6c7e6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:16.355390 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deea8d-7bdc-493e-b553-81b3a6c7e6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:16.357264 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-52deea8d-7bdc-493e-b553-81b3a6c7e6d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:16.465761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deea8d-7bdc-493e-b553-81b3a6c7e6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:16.467828 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deea8d-7bdc-493e-b553-81b3a6c7e6d3 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:16.498261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1181/2340] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:17.751509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca839056-18d3-4a68-942f-8a0398057aab service swift] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:17.752974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ca839056-18d3-4a68-942f-8a0398057aab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:17.765225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca839056-18d3-4a68-942f-8a0398057aab service swift] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:17.769213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8327c-3bce-41a8-a2ae-81bd2ff08fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:17.769861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8327c-3bce-41a8-a2ae-81bd2ff08fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:17.770147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8327c-3bce-41a8-a2ae-81bd2ff08fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:17.770562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8327c-3bce-41a8-a2ae-81bd2ff08fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:17.772357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3de8327c-3bce-41a8-a2ae-81bd2ff08fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:17.786953 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8327c-3bce-41a8-a2ae-81bd2ff08fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:17.788859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8327c-3bce-41a8-a2ae-81bd2ff08fa7 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:17.805186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1160/2341] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:21.137046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deea8d-7bdc-493e-b553-81b3a6c7e6d3 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:21.138382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-52deea8d-7bdc-493e-b553-81b3a6c7e6d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:21.234263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deea8d-7bdc-493e-b553-81b3a6c7e6d3 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:21.239635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:21.240630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:21.240915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:21.241237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] PATH_INFO: `/v3/users/022e761cfc694697b0ef9886025abc5e` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:21.242438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=022e761cfc694697b0ef9886025abc5e)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:21.244614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:21.477609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022e761cfc694697b0ef9886025abc5e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:25:21.579400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022e761cfc694697b0ef9886025abc5e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:25:21.581333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:21.598605 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022e761cfc694697b0ef9886025abc5e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:25:21.599581 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022e761cfc694697b0ef9886025abc5e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:25:21.607723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5c5abc2f-00f2-4d38-b5c0-b4d105d91a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022e761cfc694697b0ef9886025abc5e'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:25:21.620353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1182/2342] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:25:21 2022] DELETE /identity/v3/users/022e761cfc694697b0ef9886025abc5e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:21.912718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8327c-3bce-41a8-a2ae-81bd2ff08fa7 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:21.931362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8327c-3bce-41a8-a2ae-81bd2ff08fa7 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:22.035401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:22.039040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:22.039040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:22.039040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] PATH_INFO: `/v3/projects/d8e983852747461b8ca663cd6ff56ff4` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:22.056380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e983852747461b8ca663cd6ff56ff4)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:22.056380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:22.180374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e983852747461b8ca663cd6ff56ff4', 'request_id': 'req-1ca885a0-f103-427a-a33d-7e400e10d924'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:25:22.186767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e983852747461b8ca663cd6ff56ff4', 'request_id': 'req-1ca885a0-f103-427a-a33d-7e400e10d924'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:25:22.447987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e983852747461b8ca663cd6ff56ff4', 'request_id': 'req-1ca885a0-f103-427a-a33d-7e400e10d924'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:25:22.459810 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] The token cache is being invalidate because project d8e983852747461b8ca663cd6ff56ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:25:22.460136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:25:22.460761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1ca885a0-f103-427a-a33d-7e400e10d924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:25:22.462289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1161/2343] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:25:21 2022] DELETE /identity/v3/projects/d8e983852747461b8ca663cd6ff56ff4 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:22.468140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f57b23-403e-4bc7-86d7-9a40d4c7596f None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:22.468613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f57b23-403e-4bc7-86d7-9a40d4c7596f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:22.468762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f57b23-403e-4bc7-86d7-9a40d4c7596f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:22.487057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a4f57b23-403e-4bc7-86d7-9a40d4c7596f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:22.496061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a4f57b23-403e-4bc7-86d7-9a40d4c7596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:22.552151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1183/2344] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:25:22.560939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afa6f4-4cdf-4ab7-95de-bc772e135f19 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:22.561232 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afa6f4-4cdf-4ab7-95de-bc772e135f19 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:22.561515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afa6f4-4cdf-4ab7-95de-bc772e135f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:22.580981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d2afa6f4-4cdf-4ab7-95de-bc772e135f19 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:22.582187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d2afa6f4-4cdf-4ab7-95de-bc772e135f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:22.590339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1162/2345] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:25:22.594663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f57b23-403e-4bc7-86d7-9a40d4c7596f None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:22.605656 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f57b23-403e-4bc7-86d7-9a40d4c7596f None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:22.610610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50a5a1-501a-497c-b219-1808bb612fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:22.611262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50a5a1-501a-497c-b219-1808bb612fee admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:22.611544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50a5a1-501a-497c-b219-1808bb612fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:22.611812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50a5a1-501a-497c-b219-1808bb612fee admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:22.612567 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50a5a1-501a-497c-b219-1808bb612fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:22.612869 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50a5a1-501a-497c-b219-1808bb612fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:22.614460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50a5a1-501a-497c-b219-1808bb612fee admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:22.626559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1184/2346] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:22.630894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afa6f4-4cdf-4ab7-95de-bc772e135f19 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:22.640720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afa6f4-4cdf-4ab7-95de-bc772e135f19 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:22.645388 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad656dc-830a-497b-bff7-1871ad4e256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:22.646045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad656dc-830a-497b-bff7-1871ad4e256c admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:22.646328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad656dc-830a-497b-bff7-1871ad4e256c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:22.646920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad656dc-830a-497b-bff7-1871ad4e256c admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:22.647281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad656dc-830a-497b-bff7-1871ad4e256c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:22.649227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad656dc-830a-497b-bff7-1871ad4e256c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:22.753124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1163/2347] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:25:22 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:22.757202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50a5a1-501a-497c-b219-1808bb612fee admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:22.769032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50a5a1-501a-497c-b219-1808bb612fee admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:22.829150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420d3e-02b0-44db-bef7-025f6ea71937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:22.829832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420d3e-02b0-44db-bef7-025f6ea71937 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:22.830114 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420d3e-02b0-44db-bef7-025f6ea71937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:22.830389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420d3e-02b0-44db-bef7-025f6ea71937 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:22.831085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13420d3e-02b0-44db-bef7-025f6ea71937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:22.833078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13420d3e-02b0-44db-bef7-025f6ea71937 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:22.916798 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1185/2348] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:25:22 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:22.921453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad656dc-830a-497b-bff7-1871ad4e256c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:22.931904 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad656dc-830a-497b-bff7-1871ad4e256c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:22.937175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cc007-c6f1-46f3-b574-f520b5828123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:22.937841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc007-c6f1-46f3-b574-f520b5828123 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:22.938128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc007-c6f1-46f3-b574-f520b5828123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:22.938412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc007-c6f1-46f3-b574-f520b5828123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:22.939182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cc007-c6f1-46f3-b574-f520b5828123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:22.940807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cc007-c6f1-46f3-b574-f520b5828123 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:22.951182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1164/2349] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:25:22.955310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420d3e-02b0-44db-bef7-025f6ea71937 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:22.965845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420d3e-02b0-44db-bef7-025f6ea71937 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:22.970569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642bfb8-541d-4761-8020-47fc23d4896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:22.971237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642bfb8-541d-4761-8020-47fc23d4896c admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:22.971627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642bfb8-541d-4761-8020-47fc23d4896c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:22.971973 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642bfb8-541d-4761-8020-47fc23d4896c admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:22.973286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642bfb8-541d-4761-8020-47fc23d4896c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:22.974900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642bfb8-541d-4761-8020-47fc23d4896c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:22.986942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1186/2350] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:25:22.991834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cc007-c6f1-46f3-b574-f520b5828123 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:23.007295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cc007-c6f1-46f3-b574-f520b5828123 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:23.007295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2e27-d03d-4ef1-9637-15fe5021e817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:23.008149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2e27-d03d-4ef1-9637-15fe5021e817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:23.008438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2e27-d03d-4ef1-9637-15fe5021e817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:23.008725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2e27-d03d-4ef1-9637-15fe5021e817 admin admin] PATH_INFO: `/v3/projects/d82d4304c5074210bb0dc8bc1f77b5fe/users/256b3a388c20479c9ea017dd7558e76b/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:23.019428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:23.028178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f2e27-d03d-4ef1-9637-15fe5021e817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82d4304c5074210bb0dc8bc1f77b5fe, user_id=256b3a388c20479c9ea017dd7558e76b, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:23.031256 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f2e27-d03d-4ef1-9637-15fe5021e817 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:23.109435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1165/2351] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:25:22 2022] PUT /identity/v3/projects/d82d4304c5074210bb0dc8bc1f77b5fe/users/256b3a388c20479c9ea017dd7558e76b/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:23.111316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5e94d-b748-48ee-9396-1cf3aa438fb2 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:23.111614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5e94d-b748-48ee-9396-1cf3aa438fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:23.112018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5e94d-b748-48ee-9396-1cf3aa438fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:23.149629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a9b5e94d-b748-48ee-9396-1cf3aa438fb2 None None] MFA Rules not processed for user `256b3a388c20479c9ea017dd7558e76b`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:23.151102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a9b5e94d-b748-48ee-9396-1cf3aa438fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:23.188337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:23.247728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1187/2352] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:25:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:25:23.261577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2e27-d03d-4ef1-9637-15fe5021e817 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:23.263732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fe6f2e27-d03d-4ef1-9637-15fe5021e817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:23.351259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2e27-d03d-4ef1-9637-15fe5021e817 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:23.355029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a570a-020b-4861-bc84-c2945aa4a128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:23.355740 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a570a-020b-4861-bc84-c2945aa4a128 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:23.356058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a570a-020b-4861-bc84-c2945aa4a128 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:23.356338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a570a-020b-4861-bc84-c2945aa4a128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:23.371320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a570a-020b-4861-bc84-c2945aa4a128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:23.373627 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a570a-020b-4861-bc84-c2945aa4a128 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:23.388177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1166/2353] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:31.069353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5e94d-b748-48ee-9396-1cf3aa438fb2 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:31.070793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a9b5e94d-b748-48ee-9396-1cf3aa438fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:31.143237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5e94d-b748-48ee-9396-1cf3aa438fb2 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:31.148775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30a6ef-809e-4efc-89b0-99ea11aecbbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:31.153715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30a6ef-809e-4efc-89b0-99ea11aecbbe service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:31.153715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30a6ef-809e-4efc-89b0-99ea11aecbbe service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:31.153715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30a6ef-809e-4efc-89b0-99ea11aecbbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:31.153715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0e30a6ef-809e-4efc-89b0-99ea11aecbbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:31.228129 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30a6ef-809e-4efc-89b0-99ea11aecbbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:31.229873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30a6ef-809e-4efc-89b0-99ea11aecbbe service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:31.241856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1188/2354] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:33.124306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a570a-020b-4861-bc84-c2945aa4a128 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:33.125902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ec0a570a-020b-4861-bc84-c2945aa4a128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:33.181591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a570a-020b-4861-bc84-c2945aa4a128 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:33.185902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307a1be-ec69-41dd-8937-77f7da4f83f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:33.186555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307a1be-ec69-41dd-8937-77f7da4f83f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:33.187995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307a1be-ec69-41dd-8937-77f7da4f83f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:33.187995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307a1be-ec69-41dd-8937-77f7da4f83f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:33.188973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0307a1be-ec69-41dd-8937-77f7da4f83f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:33.198416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307a1be-ec69-41dd-8937-77f7da4f83f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:33.199840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307a1be-ec69-41dd-8937-77f7da4f83f2 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:33.208678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1167/2355] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:33.555891 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5186a3-cc87-460c-b29b-15dd5aa848fd None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:33.556431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5186a3-cc87-460c-b29b-15dd5aa848fd None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:33.556771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5186a3-cc87-460c-b29b-15dd5aa848fd None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:33.558363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1189/2356] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:33.565608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555df75-eeb3-4741-b38e-8602cdee514a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:33.566022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555df75-eeb3-4741-b38e-8602cdee514a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:33.566401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555df75-eeb3-4741-b38e-8602cdee514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:33.607943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b555df75-eeb3-4741-b38e-8602cdee514a None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:33.609157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b555df75-eeb3-4741-b38e-8602cdee514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:33.624055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1168/2357] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:25:33.635609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5186a3-cc87-460c-b29b-15dd5aa848fd None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:33.637430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4c5186a3-cc87-460c-b29b-15dd5aa848fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:33.696092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5186a3-cc87-460c-b29b-15dd5aa848fd None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:33.699470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb1d59-fd8f-45b1-96ab-cc993954d18f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '979519f42f7d463bb2ee1d5b0bb72a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:33.700146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb1d59-fd8f-45b1-96ab-cc993954d18f service glance] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:33.700459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb1d59-fd8f-45b1-96ab-cc993954d18f service glance] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:33.700740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb1d59-fd8f-45b1-96ab-cc993954d18f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:33.710939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb1d59-fd8f-45b1-96ab-cc993954d18f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:33.712396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb1d59-fd8f-45b1-96ab-cc993954d18f service glance] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:33.723229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1190/2358] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:33.929403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a421826-9281-4aee-a1fd-1d7127c2a908 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:33.929693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a421826-9281-4aee-a1fd-1d7127c2a908 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:33.929975 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a421826-9281-4aee-a1fd-1d7127c2a908 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:33.931389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1169/2359] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:33.936221 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8e5ee-2921-4ac4-a477-9b1b0761ccb6 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:33.936581 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8e5ee-2921-4ac4-a477-9b1b0761ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:33.936857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8e5ee-2921-4ac4-a477-9b1b0761ccb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:33.952866 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:33.972646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d4b8e5ee-2921-4ac4-a477-9b1b0761ccb6 None None] MFA Rules not processed for user `ae7551e9626541d49a1be9330094f42e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:33.973851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d4b8e5ee-2921-4ac4-a477-9b1b0761ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:33.980417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1191/2360] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:25:33.993283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a421826-9281-4aee-a1fd-1d7127c2a908 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:34.017511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a421826-9281-4aee-a1fd-1d7127c2a908 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:34.022994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb931f68-1509-4a28-a0c0-8a9046a0c6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:34.024091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931f68-1509-4a28-a0c0-8a9046a0c6df service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.024687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931f68-1509-4a28-a0c0-8a9046a0c6df service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.025195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931f68-1509-4a28-a0c0-8a9046a0c6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.044020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb931f68-1509-4a28-a0c0-8a9046a0c6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:34.046251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb931f68-1509-4a28-a0c0-8a9046a0c6df service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:34.055900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1170/2361] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:34.084465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8e5ee-2921-4ac4-a477-9b1b0761ccb6 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:34.104036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8e5ee-2921-4ac4-a477-9b1b0761ccb6 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:34.112088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef7a9-3df7-4b85-a6a7-9f0a8adfe607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:34.113535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef7a9-3df7-4b85-a6a7-9f0a8adfe607 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.113896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef7a9-3df7-4b85-a6a7-9f0a8adfe607 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.114248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef7a9-3df7-4b85-a6a7-9f0a8adfe607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.117995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3d5ef7a9-3df7-4b85-a6a7-9f0a8adfe607 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:34.153444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fc773-c2b2-44fb-b365-3d204ff919ab None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.154020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fc773-c2b2-44fb-b365-3d204ff919ab None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.154126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fc773-c2b2-44fb-b365-3d204ff919ab None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.155472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1171/2362] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:34.161089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db067921-d474-4105-86f9-98f580a7c804 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.161384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db067921-d474-4105-86f9-98f580a7c804 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.161654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db067921-d474-4105-86f9-98f580a7c804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.182241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-db067921-d474-4105-86f9-98f580a7c804 None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:34.183488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-db067921-d474-4105-86f9-98f580a7c804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:34.196498 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1172/2363] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:25:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:25:34.205406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ef7a9-3df7-4b85-a6a7-9f0a8adfe607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:34.207063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ef7a9-3df7-4b85-a6a7-9f0a8adfe607 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:34.207184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db067921-d474-4105-86f9-98f580a7c804 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:34.217022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db067921-d474-4105-86f9-98f580a7c804 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:34.217440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1192/2364] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:34.221226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dea86-3dc2-4305-883e-5c8f28870cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:34.221867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dea86-3dc2-4305-883e-5c8f28870cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.222151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dea86-3dc2-4305-883e-5c8f28870cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.222425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dea86-3dc2-4305-883e-5c8f28870cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.234291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dea86-3dc2-4305-883e-5c8f28870cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:34.235816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dea86-3dc2-4305-883e-5c8f28870cd6 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:34.247575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1173/2365] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:34.309639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef7a9-3df7-4b85-a6a7-9f0a8adfe607 service nova] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:34.311554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3d5ef7a9-3df7-4b85-a6a7-9f0a8adfe607 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:34.380593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef7a9-3df7-4b85-a6a7-9f0a8adfe607 service nova] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:34.385972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3189205-5bc4-404f-9599-83460eac02b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:34.386628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3189205-5bc4-404f-9599-83460eac02b1 service placement] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:34.386939 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3189205-5bc4-404f-9599-83460eac02b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:34.387234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3189205-5bc4-404f-9599-83460eac02b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:34.389686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a3189205-5bc4-404f-9599-83460eac02b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:34.401868 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3189205-5bc4-404f-9599-83460eac02b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:34.403474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3189205-5bc4-404f-9599-83460eac02b1 service placement] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:34.414232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1193/2366] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:44.242441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:44.409928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=66 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:46.970173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dea86-3dc2-4305-883e-5c8f28870cd6 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:46.971682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-612dea86-3dc2-4305-883e-5c8f28870cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:46.982911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dea86-3dc2-4305-883e-5c8f28870cd6 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:46.986464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6339943-3112-448d-887d-04b9892c2557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:46.987217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6339943-3112-448d-887d-04b9892c2557 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:46.987507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6339943-3112-448d-887d-04b9892c2557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:46.987786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6339943-3112-448d-887d-04b9892c2557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:46.989511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f6339943-3112-448d-887d-04b9892c2557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:46.998592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6339943-3112-448d-887d-04b9892c2557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:47.000063 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6339943-3112-448d-887d-04b9892c2557 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:47.008031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1174/2367] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:49.017015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe85e7f-3e4d-4479-bdc6-93277ffdbff1 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.017499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe85e7f-3e4d-4479-bdc6-93277ffdbff1 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.017772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe85e7f-3e4d-4479-bdc6-93277ffdbff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.035139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-cfe85e7f-3e4d-4479-bdc6-93277ffdbff1 None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:49.036388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-cfe85e7f-3e4d-4479-bdc6-93277ffdbff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:49.091299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1194/2368] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:25:49.103160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6339943-3112-448d-887d-04b9892c2557 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:49.104589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f6339943-3112-448d-887d-04b9892c2557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:49.172484 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6339943-3112-448d-887d-04b9892c2557 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:49.177803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db635e-35a3-49ae-9838-78c004139d91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:49.178459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db635e-35a3-49ae-9838-78c004139d91 service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.178747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db635e-35a3-49ae-9838-78c004139d91 service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.179049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db635e-35a3-49ae-9838-78c004139d91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.187914 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db635e-35a3-49ae-9838-78c004139d91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:49.189636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db635e-35a3-49ae-9838-78c004139d91 service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:49.197620 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1175/2369] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:25:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:25:49.345710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6ad2d-0188-492d-9738-887eb3910398 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.346002 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6ad2d-0188-492d-9738-887eb3910398 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.346282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6ad2d-0188-492d-9738-887eb3910398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.364677 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f4a6ad2d-0188-492d-9738-887eb3910398 None None] MFA Rules not processed for user `2113938dc6b94ec09e70771fdf570a85`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:49.365878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f4a6ad2d-0188-492d-9738-887eb3910398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:49.440908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1195/2370] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:25:49.764463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db635e-35a3-49ae-9838-78c004139d91 service swift] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:49.779575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db635e-35a3-49ae-9838-78c004139d91 service swift] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:49.786695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417796f-c387-4926-a7d4-ce27a182c275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:49.787998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417796f-c387-4926-a7d4-ce27a182c275 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:49.788660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417796f-c387-4926-a7d4-ce27a182c275 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:49.788969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417796f-c387-4926-a7d4-ce27a182c275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:49.791128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6417796f-c387-4926-a7d4-ce27a182c275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:49.803443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417796f-c387-4926-a7d4-ce27a182c275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:49.804941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417796f-c387-4926-a7d4-ce27a182c275 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:49.816824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1176/2371] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:25:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:25:59.432818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=50 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:59.813382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=44 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:09.539886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6ad2d-0188-492d-9738-887eb3910398 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:09.553430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6ad2d-0188-492d-9738-887eb3910398 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:09.559800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd8783-7259-476a-8301-52e7968c9e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:09.561201 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd8783-7259-476a-8301-52e7968c9e83 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:09.561382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd8783-7259-476a-8301-52e7968c9e83 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:09.561665 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd8783-7259-476a-8301-52e7968c9e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:09.563540 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-56cd8783-7259-476a-8301-52e7968c9e83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:09.576385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd8783-7259-476a-8301-52e7968c9e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:09.577986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd8783-7259-476a-8301-52e7968c9e83 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:09.589042 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1196/2372] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:26:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:26:18.875900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417796f-c387-4926-a7d4-ce27a182c275 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:18.878581 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6417796f-c387-4926-a7d4-ce27a182c275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:18.893516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417796f-c387-4926-a7d4-ce27a182c275 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:18.899129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523c667-47ca-431a-b79d-d508c721a0f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:18.899827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523c667-47ca-431a-b79d-d508c721a0f2 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.900093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523c667-47ca-431a-b79d-d508c721a0f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.900373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523c667-47ca-431a-b79d-d508c721a0f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.902137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7523c667-47ca-431a-b79d-d508c721a0f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:18.915000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523c667-47ca-431a-b79d-d508c721a0f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:18.916631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523c667-47ca-431a-b79d-d508c721a0f2 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:18.927312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1177/2373] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:26:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:26:19.584043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=6 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.752420 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4463c-027b-48c1-b2c3-fe242bd104ed None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.753056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4463c-027b-48c1-b2c3-fe242bd104ed None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.753056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4463c-027b-48c1-b2c3-fe242bd104ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.772773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-31b4463c-027b-48c1-b2c3-fe242bd104ed None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:25.774036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-31b4463c-027b-48c1-b2c3-fe242bd104ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:25.782097 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1197/2374] 10.222.0.46 () {58 vars in 967 bytes} [Thu Jun 2 13:26:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:26:25.807741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523c667-47ca-431a-b79d-d508c721a0f2 service nova] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.820614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523c667-47ca-431a-b79d-d508c721a0f2 service nova] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.826176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ceb49-cb7e-453d-b11b-94b83f01e1db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.826918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ceb49-cb7e-453d-b11b-94b83f01e1db service swift] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.827234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ceb49-cb7e-453d-b11b-94b83f01e1db service swift] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.827508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ceb49-cb7e-453d-b11b-94b83f01e1db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.836530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ceb49-cb7e-453d-b11b-94b83f01e1db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.838404 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ceb49-cb7e-453d-b11b-94b83f01e1db service swift] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.847683 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1178/2375] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:26:26.614603 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4463c-027b-48c1-b2c3-fe242bd104ed None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:26.683583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4463c-027b-48c1-b2c3-fe242bd104ed None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:26.688214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:26.689082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:26.689360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:26.689659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] PATH_INFO: `/v3/users/256b3a388c20479c9ea017dd7558e76b` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:26.690824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=256b3a388c20479c9ea017dd7558e76b)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:26.692830 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:26.883456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256b3a388c20479c9ea017dd7558e76b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:26:26.955148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256b3a388c20479c9ea017dd7558e76b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:26:26.968105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256b3a388c20479c9ea017dd7558e76b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:26:26.968804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256b3a388c20479c9ea017dd7558e76b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:26:26.976268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256b3a388c20479c9ea017dd7558e76b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:26:26.982350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1198/2376] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:26:26 2022] DELETE /identity/v3/users/256b3a388c20479c9ea017dd7558e76b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:26.988397 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028812f-7187-44c9-94c5-443d56a87721 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:26.988881 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028812f-7187-44c9-94c5-443d56a87721 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:26.989509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028812f-7187-44c9-94c5-443d56a87721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:27.008465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c028812f-7187-44c9-94c5-443d56a87721 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:27.009765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c028812f-7187-44c9-94c5-443d56a87721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:27.082396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1179/2377] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:26:27.092327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:27.093772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:27.158413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da14e9-2e4e-4cf0-a919-ee7d3927de9d admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:27.162064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988f71e-3ed3-42e4-a773-9b47d92478b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:27.162719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f71e-3ed3-42e4-a773-9b47d92478b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:27.162999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f71e-3ed3-42e4-a773-9b47d92478b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:27.163274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f71e-3ed3-42e4-a773-9b47d92478b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:27.172190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988f71e-3ed3-42e4-a773-9b47d92478b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:27.174335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988f71e-3ed3-42e4-a773-9b47d92478b4 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:27.185633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1199/2378] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:26:27.667084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028812f-7187-44c9-94c5-443d56a87721 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:27.668908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c028812f-7187-44c9-94c5-443d56a87721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:27.685327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028812f-7187-44c9-94c5-443d56a87721 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:27.692192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:27.693019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:27.693305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:27.693584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] PATH_INFO: `/v3/projects/d82d4304c5074210bb0dc8bc1f77b5fe` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:27.695140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82d4304c5074210bb0dc8bc1f77b5fe)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:27.697189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:27.833763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82d4304c5074210bb0dc8bc1f77b5fe', 'request_id': 'req-19bb0583-c122-4093-b168-a603b7844e3f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:26:27.840284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82d4304c5074210bb0dc8bc1f77b5fe', 'request_id': 'req-19bb0583-c122-4093-b168-a603b7844e3f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:26:27.904976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82d4304c5074210bb0dc8bc1f77b5fe', 'request_id': 'req-19bb0583-c122-4093-b168-a603b7844e3f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:26:27.917052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] The token cache is being invalidate because project d82d4304c5074210bb0dc8bc1f77b5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:26:27.917269 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:26:27.917943 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-19bb0583-c122-4093-b168-a603b7844e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:26:27.919504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1180/2379] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:26:27 2022] DELETE /identity/v3/projects/d82d4304c5074210bb0dc8bc1f77b5fe => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:27.925694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561a787-ffcc-4de1-9f7b-445fdc9562e7 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:27.926262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561a787-ffcc-4de1-9f7b-445fdc9562e7 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:27.926462 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561a787-ffcc-4de1-9f7b-445fdc9562e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:27.944883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7561a787-ffcc-4de1-9f7b-445fdc9562e7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:27.946118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7561a787-ffcc-4de1-9f7b-445fdc9562e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:27.956563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:28.013249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1200/2380] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:26:28.022420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c40d2-38f4-4df0-a0f3-084a54c8bba2 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:28.023147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c40d2-38f4-4df0-a0f3-084a54c8bba2 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:28.023147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c40d2-38f4-4df0-a0f3-084a54c8bba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:28.043967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-fa9c40d2-38f4-4df0-a0f3-084a54c8bba2 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:28.045198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fa9c40d2-38f4-4df0-a0f3-084a54c8bba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:28.060671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1181/2381] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:26:28.062528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561a787-ffcc-4de1-9f7b-445fdc9562e7 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:28.078116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561a787-ffcc-4de1-9f7b-445fdc9562e7 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:28.086081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77072-4f13-48f4-bb19-28e5d8601633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:28.087138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77072-4f13-48f4-bb19-28e5d8601633 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:28.087886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77072-4f13-48f4-bb19-28e5d8601633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:28.088387 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77072-4f13-48f4-bb19-28e5d8601633 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:28.089638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b77072-4f13-48f4-bb19-28e5d8601633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:28.090161 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b77072-4f13-48f4-bb19-28e5d8601633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:28.091951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b77072-4f13-48f4-bb19-28e5d8601633 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:28.105633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1201/2382] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:28.110596 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c40d2-38f4-4df0-a0f3-084a54c8bba2 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:28.120373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c40d2-38f4-4df0-a0f3-084a54c8bba2 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:28.125390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00270aea-f91c-4002-b6f9-94ec86b86a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:28.126578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00270aea-f91c-4002-b6f9-94ec86b86a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:28.127061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00270aea-f91c-4002-b6f9-94ec86b86a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:28.127337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00270aea-f91c-4002-b6f9-94ec86b86a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:28.128076 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00270aea-f91c-4002-b6f9-94ec86b86a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:28.130036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00270aea-f91c-4002-b6f9-94ec86b86a0b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:28.231003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1182/2383] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:26:28 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:28.235253 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77072-4f13-48f4-bb19-28e5d8601633 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:28.245640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77072-4f13-48f4-bb19-28e5d8601633 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:28.308930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6c0f-51d6-4277-ada7-1811246a1399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:28.309613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6c0f-51d6-4277-ada7-1811246a1399 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:28.309899 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6c0f-51d6-4277-ada7-1811246a1399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:28.310173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6c0f-51d6-4277-ada7-1811246a1399 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:28.310864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a6c0f-51d6-4277-ada7-1811246a1399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:28.312858 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a6c0f-51d6-4277-ada7-1811246a1399 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:28.405878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1202/2384] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:26:28 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:28.407467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00270aea-f91c-4002-b6f9-94ec86b86a0b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:28.420038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00270aea-f91c-4002-b6f9-94ec86b86a0b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:28.424827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89937a2e-88b6-4884-88b0-cccef581772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:28.425514 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937a2e-88b6-4884-88b0-cccef581772c admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:28.425827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937a2e-88b6-4884-88b0-cccef581772c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:28.426099 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937a2e-88b6-4884-88b0-cccef581772c admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:28.426895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89937a2e-88b6-4884-88b0-cccef581772c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:28.428600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89937a2e-88b6-4884-88b0-cccef581772c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:28.444700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1183/2385] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:26:28.450191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6c0f-51d6-4277-ada7-1811246a1399 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:28.461162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6c0f-51d6-4277-ada7-1811246a1399 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:28.466657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9da570-3da2-431c-9038-739445063c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:28.467328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da570-3da2-431c-9038-739445063c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:28.467614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da570-3da2-431c-9038-739445063c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:28.467924 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da570-3da2-431c-9038-739445063c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:28.468663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9da570-3da2-431c-9038-739445063c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:28.470317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9da570-3da2-431c-9038-739445063c47 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:28.480711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1203/2386] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:26:28.485408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89937a2e-88b6-4884-88b0-cccef581772c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:28.495766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89937a2e-88b6-4884-88b0-cccef581772c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:28.501074 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6109ba-ff0e-4f13-a94b-ef637f3b1428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:28.502011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6109ba-ff0e-4f13-a94b-ef637f3b1428 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:28.502295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6109ba-ff0e-4f13-a94b-ef637f3b1428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:28.502597 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6109ba-ff0e-4f13-a94b-ef637f3b1428 admin admin] PATH_INFO: `/v3/projects/05cc8cf8ca8a43a1bacdc454652cfde2/users/14bd9be0202b433cb1fa8be6afee8ee5/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:28.517821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6109ba-ff0e-4f13-a94b-ef637f3b1428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05cc8cf8ca8a43a1bacdc454652cfde2, user_id=14bd9be0202b433cb1fa8be6afee8ee5, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:28.520589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6109ba-ff0e-4f13-a94b-ef637f3b1428 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:28.523778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:28.614113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1184/2387] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:26:28 2022] PUT /identity/v3/projects/05cc8cf8ca8a43a1bacdc454652cfde2/users/14bd9be0202b433cb1fa8be6afee8ee5/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:28.619441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771ef93-b0b4-4a7c-a034-205aeebb2efa None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:28.619735 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771ef93-b0b4-4a7c-a034-205aeebb2efa None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:28.620060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771ef93-b0b4-4a7c-a034-205aeebb2efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:28.639334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-6771ef93-b0b4-4a7c-a034-205aeebb2efa None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:28.640646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6771ef93-b0b4-4a7c-a034-205aeebb2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:28.707004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1204/2388] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:26:28.717275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6109ba-ff0e-4f13-a94b-ef637f3b1428 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:28.718987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-de6109ba-ff0e-4f13-a94b-ef637f3b1428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:28.781217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6109ba-ff0e-4f13-a94b-ef637f3b1428 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:28.785642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d00b41-0c90-4d1f-9cf9-b7f5135e9b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:28.786305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d00b41-0c90-4d1f-9cf9-b7f5135e9b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:28.786591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d00b41-0c90-4d1f-9cf9-b7f5135e9b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:28.786868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d00b41-0c90-4d1f-9cf9-b7f5135e9b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:28.796430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d00b41-0c90-4d1f-9cf9-b7f5135e9b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:28.798450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d00b41-0c90-4d1f-9cf9-b7f5135e9b11 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:28.810816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1185/2389] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:26:34.353480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1e50b-7ea9-423f-8399-f8740400047d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.354082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1e50b-7ea9-423f-8399-f8740400047d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.354082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1e50b-7ea9-423f-8399-f8740400047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.409643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-aab1e50b-7ea9-423f-8399-f8740400047d None None] MFA Rules not processed for user `14bd9be0202b433cb1fa8be6afee8ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:34.410977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-aab1e50b-7ea9-423f-8399-f8740400047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:34.425233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.493725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1205/2390] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:26:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:26:34.498430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d00b41-0c90-4d1f-9cf9-b7f5135e9b11 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.513476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d00b41-0c90-4d1f-9cf9-b7f5135e9b11 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.517340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee4a15-d745-4151-ab81-5ba1340afc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.518020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4a15-d745-4151-ab81-5ba1340afc53 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.518307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4a15-d745-4151-ab81-5ba1340afc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.518583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4a15-d745-4151-ab81-5ba1340afc53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.519533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee4a15-d745-4151-ab81-5ba1340afc53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.521566 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee4a15-d745-4151-ab81-5ba1340afc53 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.632609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1186/2391] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:26:34 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:26:34.641751 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1e50b-7ea9-423f-8399-f8740400047d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.654064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1e50b-7ea9-423f-8399-f8740400047d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.721147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7233c-b906-4810-8de4-e5c98eda76d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.721868 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7233c-b906-4810-8de4-e5c98eda76d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.722169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7233c-b906-4810-8de4-e5c98eda76d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.722444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7233c-b906-4810-8de4-e5c98eda76d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.723141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7233c-b906-4810-8de4-e5c98eda76d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.725126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7233c-b906-4810-8de4-e5c98eda76d0 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.811807 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1206/2392] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:26:34 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:34.814004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee4a15-d745-4151-ab81-5ba1340afc53 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.825577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee4a15-d745-4151-ab81-5ba1340afc53 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.830827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fa1c6-1921-4f87-aaee-8b4a40445512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.831546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fa1c6-1921-4f87-aaee-8b4a40445512 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.831835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fa1c6-1921-4f87-aaee-8b4a40445512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.832140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fa1c6-1921-4f87-aaee-8b4a40445512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.832873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fa1c6-1921-4f87-aaee-8b4a40445512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.834485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fa1c6-1921-4f87-aaee-8b4a40445512 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.846301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1187/2393] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:26:34.850730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7233c-b906-4810-8de4-e5c98eda76d0 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.863143 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7233c-b906-4810-8de4-e5c98eda76d0 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:34.868077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25613eb-272e-4df3-b26e-93b49e5f0b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:34.868985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25613eb-272e-4df3-b26e-93b49e5f0b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.869270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25613eb-272e-4df3-b26e-93b49e5f0b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.869549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25613eb-272e-4df3-b26e-93b49e5f0b21 admin admin] PATH_INFO: `/v3/projects/c8963123cc144931a4b648dbcf9bb19f/users/900c82f6465047c4bbcdd67f3fd5d40d/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.886421 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25613eb-272e-4df3-b26e-93b49e5f0b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8963123cc144931a4b648dbcf9bb19f, user_id=900c82f6465047c4bbcdd67f3fd5d40d, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:34.889196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25613eb-272e-4df3-b26e-93b49e5f0b21 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:34.950688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1207/2394] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:26:34 2022] PUT /identity/v3/projects/c8963123cc144931a4b648dbcf9bb19f/users/900c82f6465047c4bbcdd67f3fd5d40d/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:34.954660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fa1c6-1921-4f87-aaee-8b4a40445512 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.965126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fa1c6-1921-4f87-aaee-8b4a40445512 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.022346 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec796b1e-8038-44f4-bf5e-77d1b45fb1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.023155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796b1e-8038-44f4-bf5e-77d1b45fb1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.023416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796b1e-8038-44f4-bf5e-77d1b45fb1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.023693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec796b1e-8038-44f4-bf5e-77d1b45fb1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.024454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec796b1e-8038-44f4-bf5e-77d1b45fb1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.026464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec796b1e-8038-44f4-bf5e-77d1b45fb1d3 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.036959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1188/2395] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:26:35.041066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25613eb-272e-4df3-b26e-93b49e5f0b21 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.051521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25613eb-272e-4df3-b26e-93b49e5f0b21 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.056941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd196df-a588-4350-b861-e26c18988408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.057873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd196df-a588-4350-b861-e26c18988408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.058156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd196df-a588-4350-b861-e26c18988408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.058721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd196df-a588-4350-b861-e26c18988408 admin admin] PATH_INFO: `/v3/projects/c8963123cc144931a4b648dbcf9bb19f/users/900c82f6465047c4bbcdd67f3fd5d40d/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.060772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd196df-a588-4350-b861-e26c18988408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8963123cc144931a4b648dbcf9bb19f, user_id=900c82f6465047c4bbcdd67f3fd5d40d, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.063517 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd196df-a588-4350-b861-e26c18988408 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.074806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1208/2396] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:26:35 2022] PUT /identity/v3/projects/c8963123cc144931a4b648dbcf9bb19f/users/900c82f6465047c4bbcdd67f3fd5d40d/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:41.017086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331f86-38a4-4830-9a74-ec177b0a483f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.017634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331f86-38a4-4830-9a74-ec177b0a483f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.017830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331f86-38a4-4830-9a74-ec177b0a483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.044530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-14331f86-38a4-4830-9a74-ec177b0a483f None None] MFA Rules not processed for user `900c82f6465047c4bbcdd67f3fd5d40d`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:41.045761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-14331f86-38a4-4830-9a74-ec177b0a483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:41.087190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:41.116695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1189/2397] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:26:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:26:41.132494 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd196df-a588-4350-b861-e26c18988408 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:41.134236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2cd196df-a588-4350-b861-e26c18988408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:41.204515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:41.211232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd196df-a588-4350-b861-e26c18988408 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:41.217655 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44290692-0856-49e1-95d6-e1a52e8d9a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:41.218443 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44290692-0856-49e1-95d6-e1a52e8d9a7b service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:41.218726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44290692-0856-49e1-95d6-e1a52e8d9a7b service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:41.219006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44290692-0856-49e1-95d6-e1a52e8d9a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:41.282387 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44290692-0856-49e1-95d6-e1a52e8d9a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:41.292277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44290692-0856-49e1-95d6-e1a52e8d9a7b service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:41.293297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1209/2398] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:26:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:26:51.236538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=11 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.372738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=27 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:57.453357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e0d30-68ff-475c-b313-9b9a1c24289e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:57.453862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e0d30-68ff-475c-b313-9b9a1c24289e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:57.453980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e0d30-68ff-475c-b313-9b9a1c24289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:57.475154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-654e0d30-68ff-475c-b313-9b9a1c24289e None None] MFA Rules not processed for user `5c3f539d6d374fd8b3eaa9e3e22e5cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:57.476321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-654e0d30-68ff-475c-b313-9b9a1c24289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:57.530715 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1190/2399] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:26:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:26:59.811184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44290692-0856-49e1-95d6-e1a52e8d9a7b service nova] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:59.822293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44290692-0856-49e1-95d6-e1a52e8d9a7b service nova] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:59.828352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65b7cf-bc72-4e6c-9520-3e70c86b1dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:59.829026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65b7cf-bc72-4e6c-9520-3e70c86b1dcd service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:59.829310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65b7cf-bc72-4e6c-9520-3e70c86b1dcd service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:59.829589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65b7cf-bc72-4e6c-9520-3e70c86b1dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:59.831412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ea65b7cf-bc72-4e6c-9520-3e70c86b1dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:59.844693 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65b7cf-bc72-4e6c-9520-3e70c86b1dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:59.846817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65b7cf-bc72-4e6c-9520-3e70c86b1dcd service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:59.857931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1210/2400] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:26:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:27:07.523057 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=25 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:08.960005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e0d30-68ff-475c-b313-9b9a1c24289e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:08.973086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e0d30-68ff-475c-b313-9b9a1c24289e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:08.978516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06352e-95f0-4ec0-8444-aa564a95ccff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:08.979166 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06352e-95f0-4ec0-8444-aa564a95ccff service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:08.979452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06352e-95f0-4ec0-8444-aa564a95ccff service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:08.979732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06352e-95f0-4ec0-8444-aa564a95ccff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:08.981546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1f06352e-95f0-4ec0-8444-aa564a95ccff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:09.038912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06352e-95f0-4ec0-8444-aa564a95ccff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:09.040463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06352e-95f0-4ec0-8444-aa564a95ccff service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:09.050100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1191/2401] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:27:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:27:09.853106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=6 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:15.170083 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc890d-b569-48af-8f02-67896cd86c8c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:15.170729 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc890d-b569-48af-8f02-67896cd86c8c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:15.170729 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc890d-b569-48af-8f02-67896cd86c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:15.188112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-e7fc890d-b569-48af-8f02-67896cd86c8c None None] MFA Rules not processed for user `14bd9be0202b433cb1fa8be6afee8ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:15.193370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e7fc890d-b569-48af-8f02-67896cd86c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:15.196410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1211/2402] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:27:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:19.045422 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=28 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:25.182708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:33.985555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06352e-95f0-4ec0-8444-aa564a95ccff service nova] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:33.987078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1f06352e-95f0-4ec0-8444-aa564a95ccff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:34.061538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06352e-95f0-4ec0-8444-aa564a95ccff service nova] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:34.068211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a67a-cc18-421a-8aef-7e3e523a2c65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:34.068880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a67a-cc18-421a-8aef-7e3e523a2c65 service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:34.069200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a67a-cc18-421a-8aef-7e3e523a2c65 service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:34.069481 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a67a-cc18-421a-8aef-7e3e523a2c65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:34.071310 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5079a67a-cc18-421a-8aef-7e3e523a2c65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:34.083786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079a67a-cc18-421a-8aef-7e3e523a2c65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:34.085527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079a67a-cc18-421a-8aef-7e3e523a2c65 service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:34.096273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1192/2403] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:27:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:27:34.118154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc890d-b569-48af-8f02-67896cd86c8c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:34.119930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e7fc890d-b569-48af-8f02-67896cd86c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:34.192231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc890d-b569-48af-8f02-67896cd86c8c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:34.196667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:34.198701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:34.198701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:34.198701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] PATH_INFO: `/v3/users/2113938dc6b94ec09e70771fdf570a85` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:34.199260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2113938dc6b94ec09e70771fdf570a85)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:34.201211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:34.398576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2113938dc6b94ec09e70771fdf570a85'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:34.464223 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2113938dc6b94ec09e70771fdf570a85'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:34.476479 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2113938dc6b94ec09e70771fdf570a85'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:34.477143 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2113938dc6b94ec09e70771fdf570a85'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:34.483997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-baf620cb-a148-4e46-9070-8fb06c404326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2113938dc6b94ec09e70771fdf570a85'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:34.490690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1212/2404] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:27:34 2022] DELETE /identity/v3/users/2113938dc6b94ec09e70771fdf570a85 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:34.729150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a67a-cc18-421a-8aef-7e3e523a2c65 service placement] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:34.746010 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a67a-cc18-421a-8aef-7e3e523a2c65 service placement] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:34.858058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:34.858785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:34.859143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:34.861054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] PATH_INFO: `/v3/projects/8522fa2a30e440b890516e350e17de14` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:34.861693 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8522fa2a30e440b890516e350e17de14)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:34.863831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:34.986289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8522fa2a30e440b890516e350e17de14', 'request_id': 'req-39b449ee-eb70-4642-acf5-336fa08211c6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:34.994188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8522fa2a30e440b890516e350e17de14', 'request_id': 'req-39b449ee-eb70-4642-acf5-336fa08211c6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:35.091749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8522fa2a30e440b890516e350e17de14', 'request_id': 'req-39b449ee-eb70-4642-acf5-336fa08211c6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:35.105409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] The token cache is being invalidate because project 8522fa2a30e440b890516e350e17de14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:27:35.105845 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:35.106625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39b449ee-eb70-4642-acf5-336fa08211c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:35.111867 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1193/2405] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:27:34 2022] DELETE /identity/v3/projects/8522fa2a30e440b890516e350e17de14 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:35.113632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b78ff-06a1-4b55-8afd-25b779bc1403 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.114051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b78ff-06a1-4b55-8afd-25b779bc1403 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.114430 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b78ff-06a1-4b55-8afd-25b779bc1403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.132854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d23b78ff-06a1-4b55-8afd-25b779bc1403 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:35.134169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d23b78ff-06a1-4b55-8afd-25b779bc1403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:35.201411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1213/2406] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:35.209649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1847656-d89c-4d43-aa66-8333b2da1e6a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.209941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1847656-d89c-4d43-aa66-8333b2da1e6a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.210226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1847656-d89c-4d43-aa66-8333b2da1e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.228622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f1847656-d89c-4d43-aa66-8333b2da1e6a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:35.234838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f1847656-d89c-4d43-aa66-8333b2da1e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:35.238231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1194/2407] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:35.242643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b78ff-06a1-4b55-8afd-25b779bc1403 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:35.253231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b78ff-06a1-4b55-8afd-25b779bc1403 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:35.258150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9c703-2947-49fb-b088-9c7c667c6d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:35.258823 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c703-2947-49fb-b088-9c7c667c6d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.259110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c703-2947-49fb-b088-9c7c667c6d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.259383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c703-2947-49fb-b088-9c7c667c6d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.260145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9c703-2947-49fb-b088-9c7c667c6d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:35.260455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9c703-2947-49fb-b088-9c7c667c6d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:35.262110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9c703-2947-49fb-b088-9c7c667c6d9e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:35.274239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1214/2408] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:35.281164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1847656-d89c-4d43-aa66-8333b2da1e6a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:35.288788 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1847656-d89c-4d43-aa66-8333b2da1e6a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:35.293707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b65598-5c34-441c-923c-fcd31c5f3dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:35.294374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b65598-5c34-441c-923c-fcd31c5f3dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.294662 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b65598-5c34-441c-923c-fcd31c5f3dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.294961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b65598-5c34-441c-923c-fcd31c5f3dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.295636 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b65598-5c34-441c-923c-fcd31c5f3dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:35.298222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b65598-5c34-441c-923c-fcd31c5f3dd1 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:35.308704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:35.402210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1195/2409] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:27:35 2022] POST /identity/v3/projects => generated 397 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:35.406371 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9c703-2947-49fb-b088-9c7c667c6d9e admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:35.417110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9c703-2947-49fb-b088-9c7c667c6d9e admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:35.421231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:35.480484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5961-42ec-4e36-9701-1213bc563be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:35.481205 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5961-42ec-4e36-9701-1213bc563be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.481494 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5961-42ec-4e36-9701-1213bc563be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.481773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5961-42ec-4e36-9701-1213bc563be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.482484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc5961-42ec-4e36-9701-1213bc563be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:35.484525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc5961-42ec-4e36-9701-1213bc563be3 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:35.590498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1215/2410] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:27:35 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:35.595095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b65598-5c34-441c-923c-fcd31c5f3dd1 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:35.605464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b65598-5c34-441c-923c-fcd31c5f3dd1 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:35.610111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8069b-1871-40ee-a762-9e3c6df224ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:35.611400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8069b-1871-40ee-a762-9e3c6df224ad admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.611686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8069b-1871-40ee-a762-9e3c6df224ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.611998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8069b-1871-40ee-a762-9e3c6df224ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.612723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8069b-1871-40ee-a762-9e3c6df224ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:35.614339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8069b-1871-40ee-a762-9e3c6df224ad admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:35.624913 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1196/2411] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:27:35.629105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5961-42ec-4e36-9701-1213bc563be3 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:35.639333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5961-42ec-4e36-9701-1213bc563be3 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:35.644142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5100e11-22ee-4ec6-a62c-41add72199cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:35.644836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5100e11-22ee-4ec6-a62c-41add72199cc admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.645116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5100e11-22ee-4ec6-a62c-41add72199cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.645393 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5100e11-22ee-4ec6-a62c-41add72199cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.646187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5100e11-22ee-4ec6-a62c-41add72199cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:35.647804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5100e11-22ee-4ec6-a62c-41add72199cc admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:35.658648 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1216/2412] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:27:35.663325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8069b-1871-40ee-a762-9e3c6df224ad admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:35.673598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8069b-1871-40ee-a762-9e3c6df224ad admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:35.678284 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f72e5-e82f-4f50-919c-128ae1797aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:35.679175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f72e5-e82f-4f50-919c-128ae1797aac admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.679464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f72e5-e82f-4f50-919c-128ae1797aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.679749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f72e5-e82f-4f50-919c-128ae1797aac admin admin] PATH_INFO: `/v3/projects/dc43494038454dc6832e9d1e1f5c9e4f/users/7a3b5fe490b940fbb34a450da537e6e9/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.694351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f72e5-e82f-4f50-919c-128ae1797aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc43494038454dc6832e9d1e1f5c9e4f, user_id=7a3b5fe490b940fbb34a450da537e6e9, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:35.697051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f72e5-e82f-4f50-919c-128ae1797aac admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:35.772787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1197/2413] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:27:35 2022] PUT /identity/v3/projects/dc43494038454dc6832e9d1e1f5c9e4f/users/7a3b5fe490b940fbb34a450da537e6e9/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:35.784020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d19d4-4c00-426a-b578-8b853916c700 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.784315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d19d4-4c00-426a-b578-8b853916c700 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.784597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d19d4-4c00-426a-b578-8b853916c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.811825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f54d19d4-4c00-426a-b578-8b853916c700 None None] MFA Rules not processed for user `7a3b5fe490b940fbb34a450da537e6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:35.813084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f54d19d4-4c00-426a-b578-8b853916c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:35.896998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1217/2414] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:27:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:35.909059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f72e5-e82f-4f50-919c-128ae1797aac admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:35.910822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2c8f72e5-e82f-4f50-919c-128ae1797aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:35.973880 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f72e5-e82f-4f50-919c-128ae1797aac admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:35.977572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916778c-a547-48aa-b9df-f6be8311f0be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:35.978232 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916778c-a547-48aa-b9df-f6be8311f0be service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:35.978539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916778c-a547-48aa-b9df-f6be8311f0be service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:35.978798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916778c-a547-48aa-b9df-f6be8311f0be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:35.987911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916778c-a547-48aa-b9df-f6be8311f0be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:35.989418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916778c-a547-48aa-b9df-f6be8311f0be service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:35.999191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1198/2415] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:27:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:27:38.604370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d19d4-4c00-426a-b578-8b853916c700 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:38.605751 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f54d19d4-4c00-426a-b578-8b853916c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:38.661952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d19d4-4c00-426a-b578-8b853916c700 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:38.665567 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb9a38-df95-4763-a0db-1b294d25c4ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:38.666249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb9a38-df95-4763-a0db-1b294d25c4ef service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:38.666537 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb9a38-df95-4763-a0db-1b294d25c4ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:38.666817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb9a38-df95-4763-a0db-1b294d25c4ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:38.668649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5bcb9a38-df95-4763-a0db-1b294d25c4ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:38.698477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:38.731074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb9a38-df95-4763-a0db-1b294d25c4ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:38.732576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb9a38-df95-4763-a0db-1b294d25c4ef service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:38.742651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1218/2416] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:27:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:27:45.909124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916778c-a547-48aa-b9df-f6be8311f0be service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:45.975389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916778c-a547-48aa-b9df-f6be8311f0be service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:45.980037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:45.980924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:45.981208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:45.981492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] PATH_INFO: `/v3/users/7a3b5fe490b940fbb34a450da537e6e9` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:45.982686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3b5fe490b940fbb34a450da537e6e9)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:45.984654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:46.196850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3b5fe490b940fbb34a450da537e6e9'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:46.268451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3b5fe490b940fbb34a450da537e6e9'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:46.274113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:46.281270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3b5fe490b940fbb34a450da537e6e9'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:46.282443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3b5fe490b940fbb34a450da537e6e9'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:46.289228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3b5fe490b940fbb34a450da537e6e9'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:46.295243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1199/2417] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:27:45 2022] DELETE /identity/v3/users/7a3b5fe490b940fbb34a450da537e6e9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:46.300628 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e4613-3d72-4c47-a50d-8fb37424e500 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:46.301123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e4613-3d72-4c47-a50d-8fb37424e500 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:46.301123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e4613-3d72-4c47-a50d-8fb37424e500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:46.318194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-218e4613-3d72-4c47-a50d-8fb37424e500 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:46.319405 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-218e4613-3d72-4c47-a50d-8fb37424e500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:46.376987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1219/2418] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:46.386686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:46.388168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:46.445369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de137713-b068-4e99-978d-5cb75102aa98 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:46.449088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1970a-cd0a-4320-b96e-32cf5a44390a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:46.449736 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1970a-cd0a-4320-b96e-32cf5a44390a service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:46.450021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1970a-cd0a-4320-b96e-32cf5a44390a service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:46.450300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1970a-cd0a-4320-b96e-32cf5a44390a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:46.460259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1970a-cd0a-4320-b96e-32cf5a44390a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:46.461691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1970a-cd0a-4320-b96e-32cf5a44390a service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:46.471832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1200/2419] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:27:46.853714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e4613-3d72-4c47-a50d-8fb37424e500 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:46.857691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-218e4613-3d72-4c47-a50d-8fb37424e500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:46.867234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e4613-3d72-4c47-a50d-8fb37424e500 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:46.872355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:46.873322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:46.873612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:46.873889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] PATH_INFO: `/v3/projects/dc43494038454dc6832e9d1e1f5c9e4f` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:46.875152 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc43494038454dc6832e9d1e1f5c9e4f)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:46.877657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:46.991991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc43494038454dc6832e9d1e1f5c9e4f', 'request_id': 'req-49f68d1e-8d8e-458b-8967-1c24c103b9f5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:46.998234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc43494038454dc6832e9d1e1f5c9e4f', 'request_id': 'req-49f68d1e-8d8e-458b-8967-1c24c103b9f5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:47.086125 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc43494038454dc6832e9d1e1f5c9e4f', 'request_id': 'req-49f68d1e-8d8e-458b-8967-1c24c103b9f5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:47.097287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] The token cache is being invalidate because project dc43494038454dc6832e9d1e1f5c9e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:27:47.097576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:47.098208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-49f68d1e-8d8e-458b-8967-1c24c103b9f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:27:47.099846 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1220/2420] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:27:46 2022] DELETE /identity/v3/projects/dc43494038454dc6832e9d1e1f5c9e4f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:47.104973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6b58e-22ec-47a4-95c3-9416bd0217f5 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.105461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6b58e-22ec-47a4-95c3-9416bd0217f5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.105647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6b58e-22ec-47a4-95c3-9416bd0217f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.123226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-19a6b58e-22ec-47a4-95c3-9416bd0217f5 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:47.128389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-19a6b58e-22ec-47a4-95c3-9416bd0217f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:47.183712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1201/2421] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:47.192186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b80dc8-36bc-4da7-b1ce-7a445e0ec7bb None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.192480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b80dc8-36bc-4da7-b1ce-7a445e0ec7bb None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.192861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b80dc8-36bc-4da7-b1ce-7a445e0ec7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.213123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-68b80dc8-36bc-4da7-b1ce-7a445e0ec7bb None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:47.214344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-68b80dc8-36bc-4da7-b1ce-7a445e0ec7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:47.222465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1221/2422] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:47.226733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6b58e-22ec-47a4-95c3-9416bd0217f5 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.237240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6b58e-22ec-47a4-95c3-9416bd0217f5 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.241945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec65ce9-1ed0-4e5b-b52b-ede7d9239a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.242612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec65ce9-1ed0-4e5b-b52b-ede7d9239a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.242899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec65ce9-1ed0-4e5b-b52b-ede7d9239a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.243176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec65ce9-1ed0-4e5b-b52b-ede7d9239a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.244057 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec65ce9-1ed0-4e5b-b52b-ede7d9239a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:27:47.244369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec65ce9-1ed0-4e5b-b52b-ede7d9239a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.245984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec65ce9-1ed0-4e5b-b52b-ede7d9239a9e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.258605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1202/2423] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:27:47.263032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b80dc8-36bc-4da7-b1ce-7a445e0ec7bb None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.272737 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b80dc8-36bc-4da7-b1ce-7a445e0ec7bb None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.277986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001f28b-7745-48ba-9e0d-9ebb95ca42d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.278652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001f28b-7745-48ba-9e0d-9ebb95ca42d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.278935 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001f28b-7745-48ba-9e0d-9ebb95ca42d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.279229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001f28b-7745-48ba-9e0d-9ebb95ca42d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.279950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001f28b-7745-48ba-9e0d-9ebb95ca42d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.285938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001f28b-7745-48ba-9e0d-9ebb95ca42d8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.431760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1222/2424] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:27:47 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:27:47.437727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec65ce9-1ed0-4e5b-b52b-ede7d9239a9e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.448874 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec65ce9-1ed0-4e5b-b52b-ede7d9239a9e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.508368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd3e52-e44f-468f-b461-5e9a2ce02f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.508952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd3e52-e44f-468f-b461-5e9a2ce02f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.509600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd3e52-e44f-468f-b461-5e9a2ce02f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.509600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd3e52-e44f-468f-b461-5e9a2ce02f76 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.510233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd3e52-e44f-468f-b461-5e9a2ce02f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.512171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd3e52-e44f-468f-b461-5e9a2ce02f76 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.601444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:47.607657 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1203/2425] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:27:47 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:47.612367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001f28b-7745-48ba-9e0d-9ebb95ca42d8 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.623471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001f28b-7745-48ba-9e0d-9ebb95ca42d8 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.636533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b841588-4cda-4825-8d9b-7f17f9195aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.636533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b841588-4cda-4825-8d9b-7f17f9195aae admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.636533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b841588-4cda-4825-8d9b-7f17f9195aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.636533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b841588-4cda-4825-8d9b-7f17f9195aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.636977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b841588-4cda-4825-8d9b-7f17f9195aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.636977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b841588-4cda-4825-8d9b-7f17f9195aae admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.644240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1223/2426] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:27:47.648167 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd3e52-e44f-468f-b461-5e9a2ce02f76 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.658499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd3e52-e44f-468f-b461-5e9a2ce02f76 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.663053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0e71a-59a0-464f-aef8-89b7fcee02ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.667277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e71a-59a0-464f-aef8-89b7fcee02ac admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.667277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e71a-59a0-464f-aef8-89b7fcee02ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.667277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e71a-59a0-464f-aef8-89b7fcee02ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.667277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e71a-59a0-464f-aef8-89b7fcee02ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.667277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e71a-59a0-464f-aef8-89b7fcee02ac admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.679170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1204/2427] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:27:47.683243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b841588-4cda-4825-8d9b-7f17f9195aae admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.693118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b841588-4cda-4825-8d9b-7f17f9195aae admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.697702 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4351-cc7f-4876-84be-7fe4738c3670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.698587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4351-cc7f-4876-84be-7fe4738c3670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.698872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4351-cc7f-4876-84be-7fe4738c3670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.699145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4351-cc7f-4876-84be-7fe4738c3670 admin admin] PATH_INFO: `/v3/projects/a67e5bfde6ef4a358150b1ba035d5f1a/users/8446bcbe46d041789a0a7c5c270fd7ef/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.702167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:47.713917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4351-cc7f-4876-84be-7fe4738c3670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67e5bfde6ef4a358150b1ba035d5f1a, user_id=8446bcbe46d041789a0a7c5c270fd7ef, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.716619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4351-cc7f-4876-84be-7fe4738c3670 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.806121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1224/2428] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:27:47 2022] PUT /identity/v3/projects/a67e5bfde6ef4a358150b1ba035d5f1a/users/8446bcbe46d041789a0a7c5c270fd7ef/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:47.811116 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60040806-875e-47eb-bcc2-32f9fa289829 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.811709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60040806-875e-47eb-bcc2-32f9fa289829 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.812230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60040806-875e-47eb-bcc2-32f9fa289829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.829737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-60040806-875e-47eb-bcc2-32f9fa289829 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:47.830925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-60040806-875e-47eb-bcc2-32f9fa289829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:47.888797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1205/2429] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:47.897956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4351-cc7f-4876-84be-7fe4738c3670 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:47.899956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4bcb4351-cc7f-4876-84be-7fe4738c3670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:47.956142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4351-cc7f-4876-84be-7fe4738c3670 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:47.959740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38137b-54e2-4866-911f-d458dda6cc23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:47.960424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38137b-54e2-4866-911f-d458dda6cc23 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:47.960708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38137b-54e2-4866-911f-d458dda6cc23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:47.960978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38137b-54e2-4866-911f-d458dda6cc23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:47.970607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38137b-54e2-4866-911f-d458dda6cc23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:47.972055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38137b-54e2-4866-911f-d458dda6cc23 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:47.981400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1225/2430] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:27:53.409504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b3be7-2a47-4950-947f-8b1f68eb82e9 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.410094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b3be7-2a47-4950-947f-8b1f68eb82e9 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.410241 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b3be7-2a47-4950-947f-8b1f68eb82e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.439463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-8f2b3be7-2a47-4950-947f-8b1f68eb82e9 None None] MFA Rules not processed for user `8446bcbe46d041789a0a7c5c270fd7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:53.440729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-8f2b3be7-2a47-4950-947f-8b1f68eb82e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:53.520873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1206/2431] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:27:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:53.524739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38137b-54e2-4866-911f-d458dda6cc23 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:53.534829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38137b-54e2-4866-911f-d458dda6cc23 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:53.539543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c18fe-d9aa-4d0f-8ce7-53facf790566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:53.540251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c18fe-d9aa-4d0f-8ce7-53facf790566 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.540535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c18fe-d9aa-4d0f-8ce7-53facf790566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.540809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c18fe-d9aa-4d0f-8ce7-53facf790566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.541644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c18fe-d9aa-4d0f-8ce7-53facf790566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:53.543643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c18fe-d9aa-4d0f-8ce7-53facf790566 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:53.608774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1226/2432] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:27:53 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:53.613691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b3be7-2a47-4950-947f-8b1f68eb82e9 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:53.624828 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b3be7-2a47-4950-947f-8b1f68eb82e9 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:53.685362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc323f-3bf1-4655-9a10-b39d67670f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:53.686240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc323f-3bf1-4655-9a10-b39d67670f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.686522 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc323f-3bf1-4655-9a10-b39d67670f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.686823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc323f-3bf1-4655-9a10-b39d67670f38 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.687552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc323f-3bf1-4655-9a10-b39d67670f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:53.689613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc323f-3bf1-4655-9a10-b39d67670f38 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:53.790814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1207/2433] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:27:53 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:53.794632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c18fe-d9aa-4d0f-8ce7-53facf790566 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:53.805615 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c18fe-d9aa-4d0f-8ce7-53facf790566 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:53.810578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0face99-61ed-429b-aa49-50779c48fd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:53.811237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0face99-61ed-429b-aa49-50779c48fd01 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.811554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0face99-61ed-429b-aa49-50779c48fd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.811832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0face99-61ed-429b-aa49-50779c48fd01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.812649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0face99-61ed-429b-aa49-50779c48fd01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:53.814863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0face99-61ed-429b-aa49-50779c48fd01 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:53.827321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1227/2434] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:27:53.832855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc323f-3bf1-4655-9a10-b39d67670f38 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:53.843569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc323f-3bf1-4655-9a10-b39d67670f38 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:53.848376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96131744-b225-4063-8ac0-3fae8b4f7863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:53.849268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96131744-b225-4063-8ac0-3fae8b4f7863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.849553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96131744-b225-4063-8ac0-3fae8b4f7863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.849830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96131744-b225-4063-8ac0-3fae8b4f7863 admin admin] PATH_INFO: `/v3/projects/8741b1713bfc4c5e8147e7912d80635b/users/8a982aff50404a049a242fb7d0460a51/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.852086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:53.865009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96131744-b225-4063-8ac0-3fae8b4f7863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8741b1713bfc4c5e8147e7912d80635b, user_id=8a982aff50404a049a242fb7d0460a51, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:53.867803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96131744-b225-4063-8ac0-3fae8b4f7863 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:53.921380 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1208/2435] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:27:53 2022] PUT /identity/v3/projects/8741b1713bfc4c5e8147e7912d80635b/users/8a982aff50404a049a242fb7d0460a51/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:27:53.925500 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0face99-61ed-429b-aa49-50779c48fd01 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:53.935446 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0face99-61ed-429b-aa49-50779c48fd01 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:53.992026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ddeb0-b907-42d7-a7b4-f0f5dd16806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:53.992723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddeb0-b907-42d7-a7b4-f0f5dd16806b admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:53.993003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddeb0-b907-42d7-a7b4-f0f5dd16806b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:53.993273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddeb0-b907-42d7-a7b4-f0f5dd16806b admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:53.993999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ddeb0-b907-42d7-a7b4-f0f5dd16806b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:53.995616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ddeb0-b907-42d7-a7b4-f0f5dd16806b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:54.006609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1228/2436] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:27:54.010916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96131744-b225-4063-8ac0-3fae8b4f7863 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:54.021510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96131744-b225-4063-8ac0-3fae8b4f7863 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:54.026159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb9d8-10fc-4711-9008-c838a86fc3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:54.027104 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb9d8-10fc-4711-9008-c838a86fc3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:54.027388 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb9d8-10fc-4711-9008-c838a86fc3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:54.027667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb9d8-10fc-4711-9008-c838a86fc3c6 admin admin] PATH_INFO: `/v3/projects/8741b1713bfc4c5e8147e7912d80635b/users/8a982aff50404a049a242fb7d0460a51/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:54.029662 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fb9d8-10fc-4711-9008-c838a86fc3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8741b1713bfc4c5e8147e7912d80635b, user_id=8a982aff50404a049a242fb7d0460a51, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:54.032369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fb9d8-10fc-4711-9008-c838a86fc3c6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:54.042896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1209/2437] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:27:54 2022] PUT /identity/v3/projects/8741b1713bfc4c5e8147e7912d80635b/users/8a982aff50404a049a242fb7d0460a51/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:27:59.458530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e5643-a60f-4ff7-9285-46ccd5a9372b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:59.459060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e5643-a60f-4ff7-9285-46ccd5a9372b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:59.459060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e5643-a60f-4ff7-9285-46ccd5a9372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:59.490279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-492e5643-a60f-4ff7-9285-46ccd5a9372b None None] MFA Rules not processed for user `8a982aff50404a049a242fb7d0460a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:59.491612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-492e5643-a60f-4ff7-9285-46ccd5a9372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:59.534948 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:59.565179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1229/2438] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:27:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:59.580499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb9d8-10fc-4711-9008-c838a86fc3c6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:59.582260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3d9fb9d8-10fc-4711-9008-c838a86fc3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:59.661776 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb9d8-10fc-4711-9008-c838a86fc3c6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:59.667906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336bf4e-390c-490e-a1f3-b5eebb3784df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:59.668621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336bf4e-390c-490e-a1f3-b5eebb3784df service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:59.668904 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336bf4e-390c-490e-a1f3-b5eebb3784df service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:59.669176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336bf4e-390c-490e-a1f3-b5eebb3784df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:59.751226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336bf4e-390c-490e-a1f3-b5eebb3784df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:59.752869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336bf4e-390c-490e-a1f3-b5eebb3784df service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:59.761960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1210/2439] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:27:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:02.671739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c020b-d5ef-4856-855e-5aaf32ed6f17 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:02.672313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c020b-d5ef-4856-855e-5aaf32ed6f17 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:02.672946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c020b-d5ef-4856-855e-5aaf32ed6f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:02.694529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8b5c020b-d5ef-4856-855e-5aaf32ed6f17 None None] MFA Rules not processed for user `8446bcbe46d041789a0a7c5c270fd7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:02.695766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8b5c020b-d5ef-4856-855e-5aaf32ed6f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:02.705458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1230/2440] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:09.758049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=68,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:12.689190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=14 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:13.991337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e1973-57f2-433a-8f81-be88842cd164 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:13.991816 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e1973-57f2-433a-8f81-be88842cd164 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:13.991978 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e1973-57f2-433a-8f81-be88842cd164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:14.011959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f95e1973-57f2-433a-8f81-be88842cd164 None None] MFA Rules not processed for user `37a7776277ca42eba4476242438fbf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:14.013232 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f95e1973-57f2-433a-8f81-be88842cd164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:14.068295 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1211/2441] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:24.061332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=25 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:24.265176 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c020b-d5ef-4856-855e-5aaf32ed6f17 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:24.267412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8b5c020b-d5ef-4856-855e-5aaf32ed6f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:24.337682 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c020b-d5ef-4856-855e-5aaf32ed6f17 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:24.343593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9ffb-84bb-4f82-a497-17c7201f2c64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:24.344292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9ffb-84bb-4f82-a497-17c7201f2c64 service placement] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:24.344582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9ffb-84bb-4f82-a497-17c7201f2c64 service placement] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:24.344863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9ffb-84bb-4f82-a497-17c7201f2c64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:24.346703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d5ca9ffb-84bb-4f82-a497-17c7201f2c64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:24.358686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9ffb-84bb-4f82-a497-17c7201f2c64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:24.360341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9ffb-84bb-4f82-a497-17c7201f2c64 service placement] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:24.370186 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1231/2442] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:34.366137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=32 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:43.967866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e1973-57f2-433a-8f81-be88842cd164 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:44.025917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e1973-57f2-433a-8f81-be88842cd164 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:44.029590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc24a19-622e-40c2-9584-2d246a2568d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:44.030252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc24a19-622e-40c2-9584-2d246a2568d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:44.030542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc24a19-622e-40c2-9584-2d246a2568d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:44.030824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc24a19-622e-40c2-9584-2d246a2568d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:44.033249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6dc24a19-622e-40c2-9584-2d246a2568d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:44.096651 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc24a19-622e-40c2-9584-2d246a2568d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:44.098110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc24a19-622e-40c2-9584-2d246a2568d0 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:44.108298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1212/2443] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:48.026026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9ffb-84bb-4f82-a497-17c7201f2c64 service placement] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:48.037728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9ffb-84bb-4f82-a497-17c7201f2c64 service placement] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:48.043215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b414-aa5b-4c62-921a-43ec388b4636 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:48.044033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b414-aa5b-4c62-921a-43ec388b4636 service placement] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:48.044394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b414-aa5b-4c62-921a-43ec388b4636 service placement] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:48.044726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b414-aa5b-4c62-921a-43ec388b4636 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:48.046607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8514b414-aa5b-4c62-921a-43ec388b4636 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:48.058786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514b414-aa5b-4c62-921a-43ec388b4636 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:48.060536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514b414-aa5b-4c62-921a-43ec388b4636 service placement] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:48.070827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1232/2444] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:48.167322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc24a19-622e-40c2-9584-2d246a2568d0 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:48.168801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6dc24a19-622e-40c2-9584-2d246a2568d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:48.181232 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc24a19-622e-40c2-9584-2d246a2568d0 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:48.185725 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:48.186603 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:48.186889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:48.187280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] PATH_INFO: `/v3/users/5c3f539d6d374fd8b3eaa9e3e22e5cb1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:48.188449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3f539d6d374fd8b3eaa9e3e22e5cb1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:48.190372 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:48.374507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3f539d6d374fd8b3eaa9e3e22e5cb1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:48.434197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3f539d6d374fd8b3eaa9e3e22e5cb1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:48.447619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3f539d6d374fd8b3eaa9e3e22e5cb1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:48.452059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3f539d6d374fd8b3eaa9e3e22e5cb1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:48.455781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7e8f316c-0116-45f6-b2a2-f5943e1ef09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3f539d6d374fd8b3eaa9e3e22e5cb1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:48.461723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1213/2445] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:28:48 2022] DELETE /identity/v3/users/5c3f539d6d374fd8b3eaa9e3e22e5cb1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:48.698477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b414-aa5b-4c62-921a-43ec388b4636 service placement] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:48.713386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b414-aa5b-4c62-921a-43ec388b4636 service placement] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:48.770043 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:48.770923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:48.771208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:48.771487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] PATH_INFO: `/v3/projects/dd922c0d796647f8891bf4c5671e4c7b` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:48.772701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd922c0d796647f8891bf4c5671e4c7b)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:48.774621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:48.897044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd922c0d796647f8891bf4c5671e4c7b', 'request_id': 'req-62587c69-b740-432a-a84a-7e794d54be19'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:48.903502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd922c0d796647f8891bf4c5671e4c7b', 'request_id': 'req-62587c69-b740-432a-a84a-7e794d54be19'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:48.988649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd922c0d796647f8891bf4c5671e4c7b', 'request_id': 'req-62587c69-b740-432a-a84a-7e794d54be19'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:49.000770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] The token cache is being invalidate because project dd922c0d796647f8891bf4c5671e4c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:28:49.001061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:49.001773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-62587c69-b740-432a-a84a-7e794d54be19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:49.003346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1233/2446] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:28:48 2022] DELETE /identity/v3/projects/dd922c0d796647f8891bf4c5671e4c7b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:49.008552 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517054-0a18-474c-ac23-ac53e2953311 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:49.008901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517054-0a18-474c-ac23-ac53e2953311 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:49.009196 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517054-0a18-474c-ac23-ac53e2953311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:49.029670 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-77517054-0a18-474c-ac23-ac53e2953311 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:49.030922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-77517054-0a18-474c-ac23-ac53e2953311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:49.050202 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:49.094628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1214/2447] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:49.108226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea6f72-1957-434f-9c73-260519171814 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:49.108725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea6f72-1957-434f-9c73-260519171814 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:49.108848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea6f72-1957-434f-9c73-260519171814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:49.129390 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ceea6f72-1957-434f-9c73-260519171814 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:49.132067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ceea6f72-1957-434f-9c73-260519171814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:49.138780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1234/2448] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:49.143189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77517054-0a18-474c-ac23-ac53e2953311 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:49.153070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77517054-0a18-474c-ac23-ac53e2953311 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:49.158304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c2a01-fea8-4b5c-81ce-45725fd7309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:49.158973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2a01-fea8-4b5c-81ce-45725fd7309d admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:49.159264 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2a01-fea8-4b5c-81ce-45725fd7309d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:49.159540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2a01-fea8-4b5c-81ce-45725fd7309d admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:49.160304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c2a01-fea8-4b5c-81ce-45725fd7309d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:49.160618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c2a01-fea8-4b5c-81ce-45725fd7309d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:49.162217 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c2a01-fea8-4b5c-81ce-45725fd7309d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:49.176315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1215/2449] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:49.182130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea6f72-1957-434f-9c73-260519171814 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:49.191767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea6f72-1957-434f-9c73-260519171814 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:49.196711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec612fc-4a4a-4574-ab6a-b4756a354919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:49.197378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec612fc-4a4a-4574-ab6a-b4756a354919 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:49.197664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec612fc-4a4a-4574-ab6a-b4756a354919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:49.197947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec612fc-4a4a-4574-ab6a-b4756a354919 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:49.198659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec612fc-4a4a-4574-ab6a-b4756a354919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:49.200623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec612fc-4a4a-4574-ab6a-b4756a354919 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:49.264402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1235/2450] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:28:49 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:28:49.268687 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c2a01-fea8-4b5c-81ce-45725fd7309d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:49.278977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c2a01-fea8-4b5c-81ce-45725fd7309d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:49.339189 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155aed0-3bf3-4b7c-afcf-0bdb713305a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:49.339898 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155aed0-3bf3-4b7c-afcf-0bdb713305a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:49.340195 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155aed0-3bf3-4b7c-afcf-0bdb713305a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:49.340480 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155aed0-3bf3-4b7c-afcf-0bdb713305a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:49.341239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155aed0-3bf3-4b7c-afcf-0bdb713305a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:49.343174 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155aed0-3bf3-4b7c-afcf-0bdb713305a6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:49.459153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1216/2451] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:28:49 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:28:49.463724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec612fc-4a4a-4574-ab6a-b4756a354919 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:49.475344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec612fc-4a4a-4574-ab6a-b4756a354919 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:49.480414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd653cad-96b7-41a0-928c-0658ea2ef221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:49.481169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd653cad-96b7-41a0-928c-0658ea2ef221 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:49.481556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd653cad-96b7-41a0-928c-0658ea2ef221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:49.481933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd653cad-96b7-41a0-928c-0658ea2ef221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:49.482744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd653cad-96b7-41a0-928c-0658ea2ef221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:49.484754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd653cad-96b7-41a0-928c-0658ea2ef221 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:49.501900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155aed0-3bf3-4b7c-afcf-0bdb713305a6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:49.507652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1236/2452] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:28:49.513721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155aed0-3bf3-4b7c-afcf-0bdb713305a6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:49.521105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a70281-d90f-4d1d-8281-225888d9271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:49.521918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a70281-d90f-4d1d-8281-225888d9271a admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:49.522310 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a70281-d90f-4d1d-8281-225888d9271a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:49.522720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a70281-d90f-4d1d-8281-225888d9271a admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:49.523571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a70281-d90f-4d1d-8281-225888d9271a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:49.525500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a70281-d90f-4d1d-8281-225888d9271a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:49.540279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1217/2453] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:28:49.542725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd653cad-96b7-41a0-928c-0658ea2ef221 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:49.554048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd653cad-96b7-41a0-928c-0658ea2ef221 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:49.558999 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223ae6-c748-4d2f-830b-916bf245ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:49.560214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223ae6-c748-4d2f-830b-916bf245ccc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:49.560667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223ae6-c748-4d2f-830b-916bf245ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:49.561058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223ae6-c748-4d2f-830b-916bf245ccc9 admin admin] PATH_INFO: `/v3/projects/8df964527b854123bccbe202b7b7679c/users/4ca8df461be849bea18f6f52d1339dd8/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:49.584672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223ae6-c748-4d2f-830b-916bf245ccc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df964527b854123bccbe202b7b7679c, user_id=4ca8df461be849bea18f6f52d1339dd8, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:49.587895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223ae6-c748-4d2f-830b-916bf245ccc9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:49.686696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1237/2454] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:28:49 2022] PUT /identity/v3/projects/8df964527b854123bccbe202b7b7679c/users/4ca8df461be849bea18f6f52d1339dd8/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:49.696806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0cd66-78bd-4343-85d6-a2d8b10ce74e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:49.697103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0cd66-78bd-4343-85d6-a2d8b10ce74e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:49.697390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0cd66-78bd-4343-85d6-a2d8b10ce74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:49.725994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-12f0cd66-78bd-4343-85d6-a2d8b10ce74e None None] MFA Rules not processed for user `4ca8df461be849bea18f6f52d1339dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:49.727248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-12f0cd66-78bd-4343-85d6-a2d8b10ce74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:49.792464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1218/2455] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:49.802293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223ae6-c748-4d2f-830b-916bf245ccc9 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:49.804033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c1223ae6-c748-4d2f-830b-916bf245ccc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:49.819165 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:49.878570 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223ae6-c748-4d2f-830b-916bf245ccc9 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:49.884243 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ea188-236e-4906-8509-db7f6f121c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:49.885529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ea188-236e-4906-8509-db7f6f121c1c service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:49.885529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ea188-236e-4906-8509-db7f6f121c1c service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:49.885529 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ea188-236e-4906-8509-db7f6f121c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:49.893772 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ea188-236e-4906-8509-db7f6f121c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:49.895351 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ea188-236e-4906-8509-db7f6f121c1c service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:49.905076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1238/2456] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:51.048426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0cd66-78bd-4343-85d6-a2d8b10ce74e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:51.049899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-12f0cd66-78bd-4343-85d6-a2d8b10ce74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:51.069441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:51.107291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0cd66-78bd-4343-85d6-a2d8b10ce74e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:51.111571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0c5ca-9c05-475e-aeed-7c70194dd838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:51.112466 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0c5ca-9c05-475e-aeed-7c70194dd838 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:51.112748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0c5ca-9c05-475e-aeed-7c70194dd838 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:51.113027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0c5ca-9c05-475e-aeed-7c70194dd838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:51.114808 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-47a0c5ca-9c05-475e-aeed-7c70194dd838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:51.178668 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0c5ca-9c05-475e-aeed-7c70194dd838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:51.180387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0c5ca-9c05-475e-aeed-7c70194dd838 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:51.191800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1219/2457] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:51.918964 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ea188-236e-4906-8509-db7f6f121c1c service nova] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:51.960346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ea188-236e-4906-8509-db7f6f121c1c service nova] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:51.993128 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c5708-fc75-4ac5-a574-3dc8bc98482f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:51.994082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c5708-fc75-4ac5-a574-3dc8bc98482f service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:51.994569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c5708-fc75-4ac5-a574-3dc8bc98482f service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:51.995006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c5708-fc75-4ac5-a574-3dc8bc98482f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:51.998938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7d2c5708-fc75-4ac5-a574-3dc8bc98482f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:52.107651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c5708-fc75-4ac5-a574-3dc8bc98482f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:52.109550 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c5708-fc75-4ac5-a574-3dc8bc98482f service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:52.121739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1239/2458] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:53.120347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0c5ca-9c05-475e-aeed-7c70194dd838 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:53.195784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0c5ca-9c05-475e-aeed-7c70194dd838 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:53.200650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:53.201541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:53.201830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:53.202109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] PATH_INFO: `/v3/users/4ca8df461be849bea18f6f52d1339dd8` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:53.204274 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca8df461be849bea18f6f52d1339dd8)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:53.206432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:53.426712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca8df461be849bea18f6f52d1339dd8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:53.496386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca8df461be849bea18f6f52d1339dd8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:53.510098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:53.520115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca8df461be849bea18f6f52d1339dd8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:53.528408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca8df461be849bea18f6f52d1339dd8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:53.542207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca8df461be849bea18f6f52d1339dd8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:53.560341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1220/2459] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:28:53 2022] DELETE /identity/v3/users/4ca8df461be849bea18f6f52d1339dd8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:53.561902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ee9e-4fb1-4054-b435-37fc00f230b9 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:53.562942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ee9e-4fb1-4054-b435-37fc00f230b9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:53.563122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ee9e-4fb1-4054-b435-37fc00f230b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:53.584011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8b30ee9e-4fb1-4054-b435-37fc00f230b9 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:53.585255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8b30ee9e-4fb1-4054-b435-37fc00f230b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:53.654689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1240/2460] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:53.666328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:53.668203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:53.775320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00d3ac-8bb4-41f5-9bbd-4102f3515425 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:53.780248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8553b6-ace7-4eb7-a839-beb8c05df1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:53.781515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8553b6-ace7-4eb7-a839-beb8c05df1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:53.781804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8553b6-ace7-4eb7-a839-beb8c05df1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:53.782090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8553b6-ace7-4eb7-a839-beb8c05df1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:53.792665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8553b6-ace7-4eb7-a839-beb8c05df1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:53.794213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8553b6-ace7-4eb7-a839-beb8c05df1f3 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:53.806107 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1221/2461] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:54.966706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ee9e-4fb1-4054-b435-37fc00f230b9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:54.966706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8b30ee9e-4fb1-4054-b435-37fc00f230b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:54.977983 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ee9e-4fb1-4054-b435-37fc00f230b9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:54.982805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:54.983687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:54.984637 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:54.985110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] PATH_INFO: `/v3/projects/8df964527b854123bccbe202b7b7679c` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:54.986489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df964527b854123bccbe202b7b7679c)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:54.988933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:55.150554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:55.164105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df964527b854123bccbe202b7b7679c', 'request_id': 'req-218c8464-da4c-4b79-bc16-848010ccfb01'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:55.183987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df964527b854123bccbe202b7b7679c', 'request_id': 'req-218c8464-da4c-4b79-bc16-848010ccfb01'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:55.263480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df964527b854123bccbe202b7b7679c', 'request_id': 'req-218c8464-da4c-4b79-bc16-848010ccfb01'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:55.277269 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] The token cache is being invalidate because project 8df964527b854123bccbe202b7b7679c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:28:55.277880 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:55.278632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-218c8464-da4c-4b79-bc16-848010ccfb01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:55.280424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1241/2462] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:28:54 2022] DELETE /identity/v3/projects/8df964527b854123bccbe202b7b7679c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:55.286495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f7e2-23e6-41b5-8a2e-d6cae64ea431 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:55.292344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f7e2-23e6-41b5-8a2e-d6cae64ea431 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:55.292344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f7e2-23e6-41b5-8a2e-d6cae64ea431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:55.307001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-fb46f7e2-23e6-41b5-8a2e-d6cae64ea431 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:55.308261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-fb46f7e2-23e6-41b5-8a2e-d6cae64ea431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:55.369649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1222/2463] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:55.377199 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a7816-8eec-4c41-b97e-b3210b2e26b2 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:55.377730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a7816-8eec-4c41-b97e-b3210b2e26b2 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:55.378015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a7816-8eec-4c41-b97e-b3210b2e26b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:55.403258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ad3a7816-8eec-4c41-b97e-b3210b2e26b2 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:55.408785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ad3a7816-8eec-4c41-b97e-b3210b2e26b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:55.436172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1242/2464] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:55.436853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f7e2-23e6-41b5-8a2e-d6cae64ea431 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:55.448661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f7e2-23e6-41b5-8a2e-d6cae64ea431 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:55.454847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68fbc0-2915-4358-9739-c48646efbb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:55.455678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68fbc0-2915-4358-9739-c48646efbb3e admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:55.456016 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68fbc0-2915-4358-9739-c48646efbb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:55.456293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68fbc0-2915-4358-9739-c48646efbb3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:55.457337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68fbc0-2915-4358-9739-c48646efbb3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:28:55.457817 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68fbc0-2915-4358-9739-c48646efbb3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:55.464397 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68fbc0-2915-4358-9739-c48646efbb3e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:55.480910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1223/2465] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:28:55.485055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a7816-8eec-4c41-b97e-b3210b2e26b2 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:55.495616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a7816-8eec-4c41-b97e-b3210b2e26b2 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:55.506917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db8101-9fc5-4c83-8fa9-db2feff31ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:55.507784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db8101-9fc5-4c83-8fa9-db2feff31ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:55.508334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db8101-9fc5-4c83-8fa9-db2feff31ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:55.508721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db8101-9fc5-4c83-8fa9-db2feff31ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:55.513234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db8101-9fc5-4c83-8fa9-db2feff31ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:55.516439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db8101-9fc5-4c83-8fa9-db2feff31ab9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:55.601905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1243/2466] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:28:55 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:28:55.606577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68fbc0-2915-4358-9739-c48646efbb3e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:55.620338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68fbc0-2915-4358-9739-c48646efbb3e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:55.704311 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598330bc-1624-4ae3-8f95-3e25dc641cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:55.705042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598330bc-1624-4ae3-8f95-3e25dc641cff admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:55.705329 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598330bc-1624-4ae3-8f95-3e25dc641cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:55.705604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598330bc-1624-4ae3-8f95-3e25dc641cff admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:55.706289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598330bc-1624-4ae3-8f95-3e25dc641cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:55.708328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598330bc-1624-4ae3-8f95-3e25dc641cff admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:55.831474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1224/2467] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:28:55 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:28:55.833549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db8101-9fc5-4c83-8fa9-db2feff31ab9 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:55.845412 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db8101-9fc5-4c83-8fa9-db2feff31ab9 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:55.850383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00945a79-c5f6-42d8-9968-a5bb0479f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:55.851363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00945a79-c5f6-42d8-9968-a5bb0479f65f admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:55.851647 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00945a79-c5f6-42d8-9968-a5bb0479f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:55.851955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00945a79-c5f6-42d8-9968-a5bb0479f65f admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:55.852734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00945a79-c5f6-42d8-9968-a5bb0479f65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:55.855086 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00945a79-c5f6-42d8-9968-a5bb0479f65f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:55.871136 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1244/2468] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:28:55.876735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598330bc-1624-4ae3-8f95-3e25dc641cff admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:55.890106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598330bc-1624-4ae3-8f95-3e25dc641cff admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:55.896221 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf6191-2891-4388-95cf-28050c0e061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:55.897823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf6191-2891-4388-95cf-28050c0e061c admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:55.897823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf6191-2891-4388-95cf-28050c0e061c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:55.897823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf6191-2891-4388-95cf-28050c0e061c admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:55.898612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf6191-2891-4388-95cf-28050c0e061c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:55.900398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf6191-2891-4388-95cf-28050c0e061c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:55.902168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:55.919629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00945a79-c5f6-42d8-9968-a5bb0479f65f admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:55.926038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1225/2469] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:28:55.937670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00945a79-c5f6-42d8-9968-a5bb0479f65f admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:55.939100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b713d27-df19-4ce5-adc7-ce22c537d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:55.940309 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713d27-df19-4ce5-adc7-ce22c537d4c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:55.940703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713d27-df19-4ce5-adc7-ce22c537d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:55.941067 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713d27-df19-4ce5-adc7-ce22c537d4c7 admin admin] PATH_INFO: `/v3/projects/927050fd8b5f4a00a6fca9bd7f4d41f3/users/44f9106cd42b4b6a9885507cf9ec2d9b/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:55.970407 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b713d27-df19-4ce5-adc7-ce22c537d4c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=927050fd8b5f4a00a6fca9bd7f4d41f3, user_id=44f9106cd42b4b6a9885507cf9ec2d9b, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:55.974441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b713d27-df19-4ce5-adc7-ce22c537d4c7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:56.070719 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1245/2470] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:28:55 2022] PUT /identity/v3/projects/927050fd8b5f4a00a6fca9bd7f4d41f3/users/44f9106cd42b4b6a9885507cf9ec2d9b/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:56.090132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928280dc-f6c6-4b4f-8fbe-d74c0b7ead59 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:56.090849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928280dc-f6c6-4b4f-8fbe-d74c0b7ead59 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:56.091156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928280dc-f6c6-4b4f-8fbe-d74c0b7ead59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:56.119041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-928280dc-f6c6-4b4f-8fbe-d74c0b7ead59 None None] MFA Rules not processed for user `44f9106cd42b4b6a9885507cf9ec2d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:56.120513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-928280dc-f6c6-4b4f-8fbe-d74c0b7ead59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:56.204314 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1226/2471] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:56.209158 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b713d27-df19-4ce5-adc7-ce22c537d4c7 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:56.288831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b713d27-df19-4ce5-adc7-ce22c537d4c7 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:56.293826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1b1d3-63b2-490f-9f04-de30f5f283c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:56.294504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1b1d3-63b2-490f-9f04-de30f5f283c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:56.294785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1b1d3-63b2-490f-9f04-de30f5f283c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:56.295063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1b1d3-63b2-490f-9f04-de30f5f283c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:56.295762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1b1d3-63b2-490f-9f04-de30f5f283c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:56.297788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1b1d3-63b2-490f-9f04-de30f5f283c4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:56.387842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1246/2472] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:28:56 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:28:56.389474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928280dc-f6c6-4b4f-8fbe-d74c0b7ead59 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:56.404574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928280dc-f6c6-4b4f-8fbe-d74c0b7ead59 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:56.482885 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e21bd-5ad7-47d4-bba4-85939f2c8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:56.483588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e21bd-5ad7-47d4-bba4-85939f2c8c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:56.483950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e21bd-5ad7-47d4-bba4-85939f2c8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:56.484285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e21bd-5ad7-47d4-bba4-85939f2c8c2d admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:56.484988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e21bd-5ad7-47d4-bba4-85939f2c8c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:56.486993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e21bd-5ad7-47d4-bba4-85939f2c8c2d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:56.605646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1227/2473] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:28:56 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:28:56.609225 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1b1d3-63b2-490f-9f04-de30f5f283c4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:56.624102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1b1d3-63b2-490f-9f04-de30f5f283c4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:56.635246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5267535-c142-48dc-88b0-b9894efd086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:56.636837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267535-c142-48dc-88b0-b9894efd086d admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:56.637494 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267535-c142-48dc-88b0-b9894efd086d admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:56.638256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267535-c142-48dc-88b0-b9894efd086d admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:56.639485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5267535-c142-48dc-88b0-b9894efd086d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:56.643581 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5267535-c142-48dc-88b0-b9894efd086d admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:56.659413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1247/2474] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:28:56.663680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e21bd-5ad7-47d4-bba4-85939f2c8c2d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:56.676484 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e21bd-5ad7-47d4-bba4-85939f2c8c2d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:56.682517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d163-570e-4d30-aaf5-1b100e405092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:56.693747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d163-570e-4d30-aaf5-1b100e405092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:56.693747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d163-570e-4d30-aaf5-1b100e405092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:56.693747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d163-570e-4d30-aaf5-1b100e405092 admin admin] PATH_INFO: `/v3/projects/f87a0ebb23e94407a62a167e48468ad8/users/c41dc09ca89b4dbda987ad0cad08423d/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:56.711584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62d163-570e-4d30-aaf5-1b100e405092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87a0ebb23e94407a62a167e48468ad8, user_id=c41dc09ca89b4dbda987ad0cad08423d, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:56.715024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62d163-570e-4d30-aaf5-1b100e405092 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:56.805465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1228/2475] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:28:56 2022] PUT /identity/v3/projects/f87a0ebb23e94407a62a167e48468ad8/users/c41dc09ca89b4dbda987ad0cad08423d/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:56.809504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5267535-c142-48dc-88b0-b9894efd086d admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:56.820216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5267535-c142-48dc-88b0-b9894efd086d admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:56.856132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:56.888449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b27e5-bb24-4b57-a0b1-0721ed379a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:56.889130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b27e5-bb24-4b57-a0b1-0721ed379a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:56.889437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b27e5-bb24-4b57-a0b1-0721ed379a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:56.889869 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b27e5-bb24-4b57-a0b1-0721ed379a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:56.891591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b27e5-bb24-4b57-a0b1-0721ed379a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:56.893252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b27e5-bb24-4b57-a0b1-0721ed379a94 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:56.907057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1248/2476] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:28:56.908305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d163-570e-4d30-aaf5-1b100e405092 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:56.921515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d163-570e-4d30-aaf5-1b100e405092 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:56.927801 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb61aa-afa4-46ef-b5c2-95fb8a53b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:56.928835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb61aa-afa4-46ef-b5c2-95fb8a53b7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:56.929268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb61aa-afa4-46ef-b5c2-95fb8a53b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:56.929405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb61aa-afa4-46ef-b5c2-95fb8a53b7c0 admin admin] PATH_INFO: `/v3/projects/f87a0ebb23e94407a62a167e48468ad8/users/c41dc09ca89b4dbda987ad0cad08423d/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:56.932400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb61aa-afa4-46ef-b5c2-95fb8a53b7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87a0ebb23e94407a62a167e48468ad8, user_id=c41dc09ca89b4dbda987ad0cad08423d, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:56.935045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb61aa-afa4-46ef-b5c2-95fb8a53b7c0 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:56.949371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1229/2477] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:28:56 2022] PUT /identity/v3/projects/f87a0ebb23e94407a62a167e48468ad8/users/c41dc09ca89b4dbda987ad0cad08423d/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:56.960065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330d050-ee22-4374-9975-b6595155d731 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:56.960514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330d050-ee22-4374-9975-b6595155d731 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:56.960888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330d050-ee22-4374-9975-b6595155d731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:56.996754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-2330d050-ee22-4374-9975-b6595155d731 None None] MFA Rules not processed for user `c41dc09ca89b4dbda987ad0cad08423d`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:56.997988 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2330d050-ee22-4374-9975-b6595155d731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:57.079422 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1249/2478] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:57.091426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb61aa-afa4-46ef-b5c2-95fb8a53b7c0 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:57.093170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2cfb61aa-afa4-46ef-b5c2-95fb8a53b7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:57.136746 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:57.152865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb61aa-afa4-46ef-b5c2-95fb8a53b7c0 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:57.156919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88cf36-3dd7-494a-9aeb-6e52d4c52f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:57.157582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88cf36-3dd7-494a-9aeb-6e52d4c52f04 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:57.157869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88cf36-3dd7-494a-9aeb-6e52d4c52f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:57.158151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88cf36-3dd7-494a-9aeb-6e52d4c52f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:57.168525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88cf36-3dd7-494a-9aeb-6e52d4c52f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:57.170021 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88cf36-3dd7-494a-9aeb-6e52d4c52f04 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:57.180888 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1230/2479] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:28:58.047028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f558b2-7934-4a70-b154-e884844f7eb2 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:58.047441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f558b2-7934-4a70-b154-e884844f7eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:58.047654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f558b2-7934-4a70-b154-e884844f7eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:58.067054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-63f558b2-7934-4a70-b154-e884844f7eb2 None None] MFA Rules not processed for user `a99a2ba62f3948e99f6e78cabade3685`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:58.070102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-63f558b2-7934-4a70-b154-e884844f7eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:58.138172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1250/2480] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:58.199175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88cf36-3dd7-494a-9aeb-6e52d4c52f04 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:58.274112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88cf36-3dd7-494a-9aeb-6e52d4c52f04 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:58.278798 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:58.279809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:58.280121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:58.280396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] PATH_INFO: `/v3/users/44f9106cd42b4b6a9885507cf9ec2d9b` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:58.282119 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f9106cd42b4b6a9885507cf9ec2d9b)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:58.284135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:58.501709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f9106cd42b4b6a9885507cf9ec2d9b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:58.571446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f9106cd42b4b6a9885507cf9ec2d9b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:58.585003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f9106cd42b4b6a9885507cf9ec2d9b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:58.585927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f9106cd42b4b6a9885507cf9ec2d9b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:58.593434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f9106cd42b4b6a9885507cf9ec2d9b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:58.599362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1231/2481] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:28:58 2022] DELETE /identity/v3/users/44f9106cd42b4b6a9885507cf9ec2d9b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:58.603962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710699-9aa6-4acb-8fea-12bf20264ec3 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:58.604334 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710699-9aa6-4acb-8fea-12bf20264ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:58.604691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710699-9aa6-4acb-8fea-12bf20264ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:58.622480 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-35710699-9aa6-4acb-8fea-12bf20264ec3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:58.623792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-35710699-9aa6-4acb-8fea-12bf20264ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:58.677635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:58.687396 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1251/2482] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:28:58.697111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:58.698525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:58.757584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113e40d-4966-44ec-a5e3-4f3a982fca78 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:58.761873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5c64-d8ed-4b58-b7c5-e95ea202d8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:58.762520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5c64-d8ed-4b58-b7c5-e95ea202d8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:58.762800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5c64-d8ed-4b58-b7c5-e95ea202d8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:58.763072 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5c64-d8ed-4b58-b7c5-e95ea202d8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:58.772639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c5c64-d8ed-4b58-b7c5-e95ea202d8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:58.774066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c5c64-d8ed-4b58-b7c5-e95ea202d8a0 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:58.783958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1232/2483] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:59.240896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710699-9aa6-4acb-8fea-12bf20264ec3 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:59.242360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-35710699-9aa6-4acb-8fea-12bf20264ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:59.256717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710699-9aa6-4acb-8fea-12bf20264ec3 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:59.261444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:59.262252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:59.262535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:59.262799 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] PATH_INFO: `/v3/projects/927050fd8b5f4a00a6fca9bd7f4d41f3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:59.264106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=927050fd8b5f4a00a6fca9bd7f4d41f3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:59.266474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:59.383231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927050fd8b5f4a00a6fca9bd7f4d41f3', 'request_id': 'req-cb7053d9-f04e-460d-837f-ed0d5da89e10'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:59.389587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927050fd8b5f4a00a6fca9bd7f4d41f3', 'request_id': 'req-cb7053d9-f04e-460d-837f-ed0d5da89e10'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:59.439908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927050fd8b5f4a00a6fca9bd7f4d41f3', 'request_id': 'req-cb7053d9-f04e-460d-837f-ed0d5da89e10'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:59.452993 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] The token cache is being invalidate because project 927050fd8b5f4a00a6fca9bd7f4d41f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:28:59.453284 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:59.454213 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:59.455867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1252/2484] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:28:59 2022] DELETE /identity/v3/projects/927050fd8b5f4a00a6fca9bd7f4d41f3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:28:59.463281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5c64-d8ed-4b58-b7c5-e95ea202d8a0 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:59.468273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:59.473865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5c64-d8ed-4b58-b7c5-e95ea202d8a0 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:59.532949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:59.533886 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:59.534157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:59.534602 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] PATH_INFO: `/v3/users/c41dc09ca89b4dbda987ad0cad08423d` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:59.535825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41dc09ca89b4dbda987ad0cad08423d)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:59.537774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:59.745951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41dc09ca89b4dbda987ad0cad08423d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:59.873433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41dc09ca89b4dbda987ad0cad08423d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:59.887842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41dc09ca89b4dbda987ad0cad08423d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:59.888604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41dc09ca89b4dbda987ad0cad08423d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:59.895891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-f82f31d5-8e58-4402-90db-5b0482035fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41dc09ca89b4dbda987ad0cad08423d'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:28:59.901961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1233/2485] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:28:59 2022] DELETE /identity/v3/users/c41dc09ca89b4dbda987ad0cad08423d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:00.390809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:00.392515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:00.408048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7053d9-f04e-460d-837f-ed0d5da89e10 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:00.465952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:00.466819 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:00.467104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:00.467384 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] PATH_INFO: `/v3/projects/f87a0ebb23e94407a62a167e48468ad8` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:00.468593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87a0ebb23e94407a62a167e48468ad8)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:00.470535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:00.577345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87a0ebb23e94407a62a167e48468ad8', 'request_id': 'req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:00.584387 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87a0ebb23e94407a62a167e48468ad8', 'request_id': 'req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:00.655594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87a0ebb23e94407a62a167e48468ad8', 'request_id': 'req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:00.666653 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] The token cache is being invalidate because project f87a0ebb23e94407a62a167e48468ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:00.666959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:00.667651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6cfa1233-f123-4f69-bef6-c0ad21ad51fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:00.669166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1253/2486] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:00 2022] DELETE /identity/v3/projects/f87a0ebb23e94407a62a167e48468ad8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:29:00.675219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7f709-f940-4fe8-bcb5-72d9be86536a None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:00.675708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7f709-f940-4fe8-bcb5-72d9be86536a None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:00.675928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7f709-f940-4fe8-bcb5-72d9be86536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:00.693762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-bae7f709-f940-4fe8-bcb5-72d9be86536a None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:00.694965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bae7f709-f940-4fe8-bcb5-72d9be86536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:00.754052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1234/2487] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:00.761925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768ff46-c2aa-4845-94ab-d93cbdc227d0 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:00.762214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768ff46-c2aa-4845-94ab-d93cbdc227d0 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:00.762490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768ff46-c2aa-4845-94ab-d93cbdc227d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:00.780434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-9768ff46-c2aa-4845-94ab-d93cbdc227d0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:00.781625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9768ff46-c2aa-4845-94ab-d93cbdc227d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:00.789414 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1254/2488] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:00.793595 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7f709-f940-4fe8-bcb5-72d9be86536a None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:00.803758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7f709-f940-4fe8-bcb5-72d9be86536a None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:00.808398 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e3591-da4c-4976-9f6e-ddf2a4408a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:00.809055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3591-da4c-4976-9f6e-ddf2a4408a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:00.809345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3591-da4c-4976-9f6e-ddf2a4408a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:00.809631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3591-da4c-4976-9f6e-ddf2a4408a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:00.810365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e3591-da4c-4976-9f6e-ddf2a4408a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:00.810678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e3591-da4c-4976-9f6e-ddf2a4408a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:00.812909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e3591-da4c-4976-9f6e-ddf2a4408a9c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:00.824289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1235/2489] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:00.828619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768ff46-c2aa-4845-94ab-d93cbdc227d0 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:00.834197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:00.838298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768ff46-c2aa-4845-94ab-d93cbdc227d0 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:00.843110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcdddf-c4c0-4e41-b669-c814d45f8947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:00.843785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdddf-c4c0-4e41-b669-c814d45f8947 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:00.849623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdddf-c4c0-4e41-b669-c814d45f8947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:00.849623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdddf-c4c0-4e41-b669-c814d45f8947 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:00.849623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcdddf-c4c0-4e41-b669-c814d45f8947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:00.849623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcdddf-c4c0-4e41-b669-c814d45f8947 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:00.938559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1255/2490] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:29:00 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:29:00.942589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e3591-da4c-4976-9f6e-ddf2a4408a9c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:00.952583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e3591-da4c-4976-9f6e-ddf2a4408a9c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:00.957136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:01.009379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444b4eb-f0a7-49a7-8475-faf35e84780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:01.010052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444b4eb-f0a7-49a7-8475-faf35e84780a admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:01.010337 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444b4eb-f0a7-49a7-8475-faf35e84780a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:01.010646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444b4eb-f0a7-49a7-8475-faf35e84780a admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:01.011343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444b4eb-f0a7-49a7-8475-faf35e84780a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:01.013321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444b4eb-f0a7-49a7-8475-faf35e84780a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:01.114381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1236/2491] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:29:00 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:01.118392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcdddf-c4c0-4e41-b669-c814d45f8947 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:01.129172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcdddf-c4c0-4e41-b669-c814d45f8947 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:01.134016 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80fbef-100e-4081-912b-d9d4d592ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:01.134686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80fbef-100e-4081-912b-d9d4d592ddf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:01.134967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80fbef-100e-4081-912b-d9d4d592ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:01.136785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80fbef-100e-4081-912b-d9d4d592ddf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:01.139113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80fbef-100e-4081-912b-d9d4d592ddf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:01.139222 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80fbef-100e-4081-912b-d9d4d592ddf4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:01.153089 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1256/2492] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:29:01.154277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444b4eb-f0a7-49a7-8475-faf35e84780a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:01.166754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444b4eb-f0a7-49a7-8475-faf35e84780a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:01.172985 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da50804-527b-4412-96d1-0f7ad53b470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:01.173964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da50804-527b-4412-96d1-0f7ad53b470a admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:01.174308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da50804-527b-4412-96d1-0f7ad53b470a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:01.174697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da50804-527b-4412-96d1-0f7ad53b470a admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:01.175532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da50804-527b-4412-96d1-0f7ad53b470a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:01.177243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da50804-527b-4412-96d1-0f7ad53b470a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:01.188646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1237/2493] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:29:01.192394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80fbef-100e-4081-912b-d9d4d592ddf4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:01.202761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80fbef-100e-4081-912b-d9d4d592ddf4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:01.207662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f662e7-e6fb-4833-bd9c-88bae3979b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:01.208590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f662e7-e6fb-4833-bd9c-88bae3979b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:01.208872 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f662e7-e6fb-4833-bd9c-88bae3979b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:01.209148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f662e7-e6fb-4833-bd9c-88bae3979b91 admin admin] PATH_INFO: `/v3/projects/6336eba7772f44a6a5c7867d8419943e/users/4a22a8050e3d441d812b920ec0b9a955/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:01.227001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f662e7-e6fb-4833-bd9c-88bae3979b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6336eba7772f44a6a5c7867d8419943e, user_id=4a22a8050e3d441d812b920ec0b9a955, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:01.229976 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f662e7-e6fb-4833-bd9c-88bae3979b91 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:01.388649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1257/2494] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:01 2022] PUT /identity/v3/projects/6336eba7772f44a6a5c7867d8419943e/users/4a22a8050e3d441d812b920ec0b9a955/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:01.399758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f98a2-0408-4f1f-bcb0-e193d4dc3712 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:01.400085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f98a2-0408-4f1f-bcb0-e193d4dc3712 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:01.401410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f98a2-0408-4f1f-bcb0-e193d4dc3712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:01.427630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-ea7f98a2-0408-4f1f-bcb0-e193d4dc3712 None None] MFA Rules not processed for user `4a22a8050e3d441d812b920ec0b9a955`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:01.428889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ea7f98a2-0408-4f1f-bcb0-e193d4dc3712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:01.492210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1238/2495] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:01.496631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f662e7-e6fb-4833-bd9c-88bae3979b91 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:01.560194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f662e7-e6fb-4833-bd9c-88bae3979b91 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:01.564941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69a6b3-1405-42d8-8f41-6d2b76f82de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:01.565608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69a6b3-1405-42d8-8f41-6d2b76f82de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:01.565895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69a6b3-1405-42d8-8f41-6d2b76f82de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:01.566176 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69a6b3-1405-42d8-8f41-6d2b76f82de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:01.566903 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69a6b3-1405-42d8-8f41-6d2b76f82de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:01.569041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69a6b3-1405-42d8-8f41-6d2b76f82de7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:01.689068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1258/2496] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:29:01 2022] POST /identity/v3/projects => generated 401 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:01.690488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f98a2-0408-4f1f-bcb0-e193d4dc3712 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:01.701007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f98a2-0408-4f1f-bcb0-e193d4dc3712 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:01.758120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90408880-42ec-45b0-92b1-cdf163b9e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:01.758712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408880-42ec-45b0-92b1-cdf163b9e906 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:01.758994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408880-42ec-45b0-92b1-cdf163b9e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:01.759277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90408880-42ec-45b0-92b1-cdf163b9e906 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:01.760004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90408880-42ec-45b0-92b1-cdf163b9e906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:01.761922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90408880-42ec-45b0-92b1-cdf163b9e906 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:01.886115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1239/2497] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:29:01 2022] POST /identity/v3/users => generated 307 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:01.890744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69a6b3-1405-42d8-8f41-6d2b76f82de7 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:01.901141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69a6b3-1405-42d8-8f41-6d2b76f82de7 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:01.905750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a81bb-c040-40ae-be4a-9d926313f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:01.906409 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a81bb-c040-40ae-be4a-9d926313f4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:01.906691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a81bb-c040-40ae-be4a-9d926313f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:01.906966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a81bb-c040-40ae-be4a-9d926313f4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:01.907688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a81bb-c040-40ae-be4a-9d926313f4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:01.909327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a81bb-c040-40ae-be4a-9d926313f4d3 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:01.920055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1259/2498] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:01.924488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90408880-42ec-45b0-92b1-cdf163b9e906 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:01.934479 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90408880-42ec-45b0-92b1-cdf163b9e906 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:01.939949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8bac-b67f-4885-b4df-074eba10e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:01.940833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8bac-b67f-4885-b4df-074eba10e970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:01.941118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8bac-b67f-4885-b4df-074eba10e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:01.941394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8bac-b67f-4885-b4df-074eba10e970 admin admin] PATH_INFO: `/v3/projects/265405d1c57f4282a14662522eb5eb5b/users/2674eae9ebef4e02b3ca773a1cb667a0/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:01.943586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:01.957103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8bac-b67f-4885-b4df-074eba10e970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=265405d1c57f4282a14662522eb5eb5b, user_id=2674eae9ebef4e02b3ca773a1cb667a0, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:01.959756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8bac-b67f-4885-b4df-074eba10e970 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:02.040429 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1240/2499] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:01 2022] PUT /identity/v3/projects/265405d1c57f4282a14662522eb5eb5b/users/2674eae9ebef4e02b3ca773a1cb667a0/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:02.044461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a81bb-c040-40ae-be4a-9d926313f4d3 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:02.054482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a81bb-c040-40ae-be4a-9d926313f4d3 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:02.116954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dfa92-d251-4055-9260-2828fb15285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:02.117662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dfa92-d251-4055-9260-2828fb15285d admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:02.117975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dfa92-d251-4055-9260-2828fb15285d admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:02.118257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dfa92-d251-4055-9260-2828fb15285d admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:02.118974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dfa92-d251-4055-9260-2828fb15285d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:02.120602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dfa92-d251-4055-9260-2828fb15285d admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:02.131248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1260/2500] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:02.135362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8bac-b67f-4885-b4df-074eba10e970 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:02.146075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8bac-b67f-4885-b4df-074eba10e970 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:02.150550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d5c34-1fce-430b-b136-46a2d1aa1f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:02.151451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d5c34-1fce-430b-b136-46a2d1aa1f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:02.151732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d5c34-1fce-430b-b136-46a2d1aa1f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:02.152044 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d5c34-1fce-430b-b136-46a2d1aa1f02 admin admin] PATH_INFO: `/v3/projects/265405d1c57f4282a14662522eb5eb5b/users/2674eae9ebef4e02b3ca773a1cb667a0/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:02.153948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d5c34-1fce-430b-b136-46a2d1aa1f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=265405d1c57f4282a14662522eb5eb5b, user_id=2674eae9ebef4e02b3ca773a1cb667a0, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:02.156638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d5c34-1fce-430b-b136-46a2d1aa1f02 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:02.166861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1241/2501] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:02 2022] PUT /identity/v3/projects/265405d1c57f4282a14662522eb5eb5b/users/2674eae9ebef4e02b3ca773a1cb667a0/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:02.177096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117870bf-a6f3-4a77-87dd-45b6cd51fd6c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:02.177389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117870bf-a6f3-4a77-87dd-45b6cd51fd6c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:02.177743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117870bf-a6f3-4a77-87dd-45b6cd51fd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:02.207171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-117870bf-a6f3-4a77-87dd-45b6cd51fd6c None None] MFA Rules not processed for user `2674eae9ebef4e02b3ca773a1cb667a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:02.208432 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-117870bf-a6f3-4a77-87dd-45b6cd51fd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:02.214568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:02.281726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1261/2502] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:29:02.289679 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d5c34-1fce-430b-b136-46a2d1aa1f02 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:02.292164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c96d5c34-1fce-430b-b136-46a2d1aa1f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:02.365753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d5c34-1fce-430b-b136-46a2d1aa1f02 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:02.370452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b27628-21c6-47f9-baf3-f11fe2a81879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:02.371126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b27628-21c6-47f9-baf3-f11fe2a81879 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:02.371574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b27628-21c6-47f9-baf3-f11fe2a81879 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:02.371861 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b27628-21c6-47f9-baf3-f11fe2a81879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:02.388488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b27628-21c6-47f9-baf3-f11fe2a81879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:02.390011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b27628-21c6-47f9-baf3-f11fe2a81879 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:02.404324 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1242/2503] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:02.667561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117870bf-a6f3-4a77-87dd-45b6cd51fd6c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:02.677908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117870bf-a6f3-4a77-87dd-45b6cd51fd6c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:02.682235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1634bb-1a95-4dcf-b38f-7b98850f80b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:02.682521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1634bb-1a95-4dcf-b38f-7b98850f80b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:02.682811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1634bb-1a95-4dcf-b38f-7b98850f80b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:02.683085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1634bb-1a95-4dcf-b38f-7b98850f80b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:02.750970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1634bb-1a95-4dcf-b38f-7b98850f80b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:02.752520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1634bb-1a95-4dcf-b38f-7b98850f80b7 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:02.762436 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1262/2504] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:04.925752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdbe7c-c55f-431e-92a4-d6e825228f92 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:04.927927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdbe7c-c55f-431e-92a4-d6e825228f92 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:04.927927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdbe7c-c55f-431e-92a4-d6e825228f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:04.944902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d6bdbe7c-c55f-431e-92a4-d6e825228f92 None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:04.946121 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d6bdbe7c-c55f-431e-92a4-d6e825228f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:05.018589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1243/2505] 10.222.0.46 () {58 vars in 967 bytes} [Thu Jun 2 13:29:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:05.314172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1634bb-1a95-4dcf-b38f-7b98850f80b7 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:05.315671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-cb1634bb-1a95-4dcf-b38f-7b98850f80b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:05.389524 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1634bb-1a95-4dcf-b38f-7b98850f80b7 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:05.395230 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd7c77-026a-4c0a-b7b6-c3c4578b57ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:05.397669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd7c77-026a-4c0a-b7b6-c3c4578b57ca service swift] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:05.397669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd7c77-026a-4c0a-b7b6-c3c4578b57ca service swift] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:05.397669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd7c77-026a-4c0a-b7b6-c3c4578b57ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:05.406072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd7c77-026a-4c0a-b7b6-c3c4578b57ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:05.407778 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd7c77-026a-4c0a-b7b6-c3c4578b57ca service swift] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:05.416402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1263/2506] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:29:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:29:06.532485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdbe7c-c55f-431e-92a4-d6e825228f92 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:06.533936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d6bdbe7c-c55f-431e-92a4-d6e825228f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:06.590599 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdbe7c-c55f-431e-92a4-d6e825228f92 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:06.594749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb1cdb-33b4-4a08-8800-b357141b473f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:06.595404 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb1cdb-33b4-4a08-8800-b357141b473f service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:06.595694 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb1cdb-33b4-4a08-8800-b357141b473f service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:06.595984 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb1cdb-33b4-4a08-8800-b357141b473f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:06.597773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-73eb1cdb-33b4-4a08-8800-b357141b473f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:06.629985 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:06.662609 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb1cdb-33b4-4a08-8800-b357141b473f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:06.664094 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb1cdb-33b4-4a08-8800-b357141b473f service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:06.676366 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1244/2507] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:08.281547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd7c77-026a-4c0a-b7b6-c3c4578b57ca service swift] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:08.293613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd7c77-026a-4c0a-b7b6-c3c4578b57ca service swift] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:08.298989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:08.300117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:08.300995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:08.301400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] PATH_INFO: `/v3/users/4a22a8050e3d441d812b920ec0b9a955` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:08.302992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a22a8050e3d441d812b920ec0b9a955)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:08.305288 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:08.441551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:08.542345 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a22a8050e3d441d812b920ec0b9a955'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:08.611121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a22a8050e3d441d812b920ec0b9a955'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:08.626038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a22a8050e3d441d812b920ec0b9a955'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:08.626949 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a22a8050e3d441d812b920ec0b9a955'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:08.636297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a22a8050e3d441d812b920ec0b9a955'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:08.647770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1264/2508] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:29:08 2022] DELETE /identity/v3/users/4a22a8050e3d441d812b920ec0b9a955 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:08.652173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215959-5fd6-40ea-880a-81b1cf0f8e7f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:08.652679 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215959-5fd6-40ea-880a-81b1cf0f8e7f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:08.652774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215959-5fd6-40ea-880a-81b1cf0f8e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:08.671180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-a0215959-5fd6-40ea-880a-81b1cf0f8e7f None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:08.672447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a0215959-5fd6-40ea-880a-81b1cf0f8e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:08.737927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1245/2509] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:29:08.748792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:08.751123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:08.820785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ba19f-45fb-4877-9b85-6653a65068fb admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:08.828274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4d092-45a2-414b-8c56-30acbc72904c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:08.830149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d092-45a2-414b-8c56-30acbc72904c service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:08.830149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d092-45a2-414b-8c56-30acbc72904c service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:08.830149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d092-45a2-414b-8c56-30acbc72904c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:08.845260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4d092-45a2-414b-8c56-30acbc72904c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:08.846873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4d092-45a2-414b-8c56-30acbc72904c service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:08.858959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1265/2510] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:09.314735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0215959-5fd6-40ea-880a-81b1cf0f8e7f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:09.316252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-a0215959-5fd6-40ea-880a-81b1cf0f8e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:09.335564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0215959-5fd6-40ea-880a-81b1cf0f8e7f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:09.346734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:09.347632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:09.347948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:09.348230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] PATH_INFO: `/v3/projects/6336eba7772f44a6a5c7867d8419943e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:09.349704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6336eba7772f44a6a5c7867d8419943e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:09.361173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:09.503420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6336eba7772f44a6a5c7867d8419943e', 'request_id': 'req-55782cc0-a671-4d46-b863-865349c26cee'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:09.509622 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6336eba7772f44a6a5c7867d8419943e', 'request_id': 'req-55782cc0-a671-4d46-b863-865349c26cee'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:09.599985 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6336eba7772f44a6a5c7867d8419943e', 'request_id': 'req-55782cc0-a671-4d46-b863-865349c26cee'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:09.617035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] The token cache is being invalidate because project 6336eba7772f44a6a5c7867d8419943e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:09.617666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:09.618062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:09.622665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1246/2511] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:09 2022] DELETE /identity/v3/projects/6336eba7772f44a6a5c7867d8419943e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:09.624098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4d092-45a2-414b-8c56-30acbc72904c service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:09.635314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4d092-45a2-414b-8c56-30acbc72904c service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:09.709200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:09.710279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:09.710563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:09.710836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] PATH_INFO: `/v3/users/2674eae9ebef4e02b3ca773a1cb667a0` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:09.712645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2674eae9ebef4e02b3ca773a1cb667a0)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:09.714754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:09.913009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2674eae9ebef4e02b3ca773a1cb667a0'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:09.915705 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:09.976440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2674eae9ebef4e02b3ca773a1cb667a0'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:09.990325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2674eae9ebef4e02b3ca773a1cb667a0'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:09.991018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2674eae9ebef4e02b3ca773a1cb667a0'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:09.998312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75623054-7b67-4b6d-84da-abac30e1fc0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2674eae9ebef4e02b3ca773a1cb667a0'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:10.004751 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1266/2512] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:29:09 2022] DELETE /identity/v3/users/2674eae9ebef4e02b3ca773a1cb667a0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:10.489734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:10.492239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:10.509013 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55782cc0-a671-4d46-b863-865349c26cee admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:10.583532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:10.603467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:10.604414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:10.605338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:10.605634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] PATH_INFO: `/v3/projects/265405d1c57f4282a14662522eb5eb5b` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:10.606911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=265405d1c57f4282a14662522eb5eb5b)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:10.609616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:10.766255 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '265405d1c57f4282a14662522eb5eb5b', 'request_id': 'req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:10.776499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '265405d1c57f4282a14662522eb5eb5b', 'request_id': 'req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:10.849829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '265405d1c57f4282a14662522eb5eb5b', 'request_id': 'req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:10.861649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] The token cache is being invalidate because project 265405d1c57f4282a14662522eb5eb5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:10.861945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:10.862588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-24571eff-8dbe-4ff6-9473-1577fbaa1fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:10.864172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1247/2513] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:10 2022] DELETE /identity/v3/projects/265405d1c57f4282a14662522eb5eb5b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:10.869190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16649390-0831-4d9f-96df-5fe50f99ec53 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:10.869662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16649390-0831-4d9f-96df-5fe50f99ec53 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:10.869881 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16649390-0831-4d9f-96df-5fe50f99ec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:10.890514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-16649390-0831-4d9f-96df-5fe50f99ec53 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:10.891738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-16649390-0831-4d9f-96df-5fe50f99ec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:10.963551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1267/2514] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:10.971306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad4ee5-d7e5-4b7f-96eb-039d136f012e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:10.972123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad4ee5-d7e5-4b7f-96eb-039d136f012e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:10.972123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad4ee5-d7e5-4b7f-96eb-039d136f012e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:10.989947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-faad4ee5-d7e5-4b7f-96eb-039d136f012e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:10.991143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-faad4ee5-d7e5-4b7f-96eb-039d136f012e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:10.998993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1248/2515] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:11.003774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16649390-0831-4d9f-96df-5fe50f99ec53 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:11.013565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16649390-0831-4d9f-96df-5fe50f99ec53 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:11.018742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da6bb1-ec28-4a4c-9aa8-4c3d27eced3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:11.019402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da6bb1-ec28-4a4c-9aa8-4c3d27eced3d admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:11.019688 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da6bb1-ec28-4a4c-9aa8-4c3d27eced3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:11.020151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da6bb1-ec28-4a4c-9aa8-4c3d27eced3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:11.020886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da6bb1-ec28-4a4c-9aa8-4c3d27eced3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:11.021196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da6bb1-ec28-4a4c-9aa8-4c3d27eced3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:11.022825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da6bb1-ec28-4a4c-9aa8-4c3d27eced3d admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:11.036041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1268/2516] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:11.040435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad4ee5-d7e5-4b7f-96eb-039d136f012e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:11.049981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad4ee5-d7e5-4b7f-96eb-039d136f012e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:11.059092 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ee3d7-3d3f-429f-b2c4-8ab0747e4f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:11.059844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee3d7-3d3f-429f-b2c4-8ab0747e4f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:11.060220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee3d7-3d3f-429f-b2c4-8ab0747e4f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:11.060500 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee3d7-3d3f-429f-b2c4-8ab0747e4f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:11.061324 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ee3d7-3d3f-429f-b2c4-8ab0747e4f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:11.063761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ee3d7-3d3f-429f-b2c4-8ab0747e4f4c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:11.155473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1249/2517] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:29:11 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:11.159724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da6bb1-ec28-4a4c-9aa8-4c3d27eced3d admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:11.170218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da6bb1-ec28-4a4c-9aa8-4c3d27eced3d admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:11.231382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e6195-66ec-4821-8a95-e356cf8d0325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:11.232237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e6195-66ec-4821-8a95-e356cf8d0325 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:11.232527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e6195-66ec-4821-8a95-e356cf8d0325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:11.232900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e6195-66ec-4821-8a95-e356cf8d0325 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:11.233514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e6195-66ec-4821-8a95-e356cf8d0325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:11.236007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e6195-66ec-4821-8a95-e356cf8d0325 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:11.403040 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1269/2518] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:29:11 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:11.408259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ee3d7-3d3f-429f-b2c4-8ab0747e4f4c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:11.421294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ee3d7-3d3f-429f-b2c4-8ab0747e4f4c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:11.426069 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799bb94-113d-482a-826f-05acaf1464c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:11.426753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799bb94-113d-482a-826f-05acaf1464c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:11.427040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799bb94-113d-482a-826f-05acaf1464c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:11.427320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799bb94-113d-482a-826f-05acaf1464c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:11.428083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799bb94-113d-482a-826f-05acaf1464c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:11.429702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799bb94-113d-482a-826f-05acaf1464c7 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:11.441796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1250/2519] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:11.446268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e6195-66ec-4821-8a95-e356cf8d0325 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:11.464578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e6195-66ec-4821-8a95-e356cf8d0325 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:11.471509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cf5cc-2e27-4041-910f-77679681bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:11.472020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf5cc-2e27-4041-910f-77679681bbdd admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:11.472307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf5cc-2e27-4041-910f-77679681bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:11.472585 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf5cc-2e27-4041-910f-77679681bbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:11.473506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cf5cc-2e27-4041-910f-77679681bbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:11.474956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cf5cc-2e27-4041-910f-77679681bbdd admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:11.488458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1270/2520] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:11.492770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799bb94-113d-482a-826f-05acaf1464c7 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:11.503286 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799bb94-113d-482a-826f-05acaf1464c7 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:11.507854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027892-6572-435d-85f8-6f928baf01da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:11.508774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027892-6572-435d-85f8-6f928baf01da admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:11.509056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027892-6572-435d-85f8-6f928baf01da admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:11.509334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027892-6572-435d-85f8-6f928baf01da admin admin] PATH_INFO: `/v3/projects/8fed292392f8410fb92e2ae0222d05e8/users/6f443849ff354c9491a393b0dc759c0b/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:11.525630 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c027892-6572-435d-85f8-6f928baf01da admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fed292392f8410fb92e2ae0222d05e8, user_id=6f443849ff354c9491a393b0dc759c0b, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:11.532888 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c027892-6572-435d-85f8-6f928baf01da admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:11.589832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1251/2521] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:11 2022] PUT /identity/v3/projects/8fed292392f8410fb92e2ae0222d05e8/users/6f443849ff354c9491a393b0dc759c0b/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:11.600855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0054d7-4b28-4a09-bc45-c7b7009a355d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:11.601157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0054d7-4b28-4a09-bc45-c7b7009a355d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:11.601439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0054d7-4b28-4a09-bc45-c7b7009a355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:11.635545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8e0054d7-4b28-4a09-bc45-c7b7009a355d None None] MFA Rules not processed for user `6f443849ff354c9491a393b0dc759c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:11.636883 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8e0054d7-4b28-4a09-bc45-c7b7009a355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:11.658874 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:11.722079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1271/2522] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:11.722762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027892-6572-435d-85f8-6f928baf01da admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:11.801190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027892-6572-435d-85f8-6f928baf01da admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:11.806396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87d3da-13bd-4e0f-a2e5-5f3607ee987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:11.808057 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87d3da-13bd-4e0f-a2e5-5f3607ee987d admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:11.808591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87d3da-13bd-4e0f-a2e5-5f3607ee987d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:11.808976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87d3da-13bd-4e0f-a2e5-5f3607ee987d admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:11.810400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87d3da-13bd-4e0f-a2e5-5f3607ee987d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:11.813323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87d3da-13bd-4e0f-a2e5-5f3607ee987d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:11.925831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1252/2523] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:29:11 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:11.927074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0054d7-4b28-4a09-bc45-c7b7009a355d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:11.938579 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0054d7-4b28-4a09-bc45-c7b7009a355d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:11.997001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ee4d5-7765-42a9-8480-97a0fcde4432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:11.997689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ee4d5-7765-42a9-8480-97a0fcde4432 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:11.997977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ee4d5-7765-42a9-8480-97a0fcde4432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:11.998254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ee4d5-7765-42a9-8480-97a0fcde4432 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:11.998971 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ee4d5-7765-42a9-8480-97a0fcde4432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:12.001558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ee4d5-7765-42a9-8480-97a0fcde4432 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:12.094785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1272/2524] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:29:11 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:12.096047 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87d3da-13bd-4e0f-a2e5-5f3607ee987d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:12.101588 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:12.107061 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87d3da-13bd-4e0f-a2e5-5f3607ee987d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:12.112623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a258f2f-7a5a-4ac9-9cdc-2246b5f05319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:12.113306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a258f2f-7a5a-4ac9-9cdc-2246b5f05319 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:12.113785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a258f2f-7a5a-4ac9-9cdc-2246b5f05319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:12.114041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a258f2f-7a5a-4ac9-9cdc-2246b5f05319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:12.114781 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a258f2f-7a5a-4ac9-9cdc-2246b5f05319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:12.116426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a258f2f-7a5a-4ac9-9cdc-2246b5f05319 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:12.129328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1253/2525] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:29:12.136838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ee4d5-7765-42a9-8480-97a0fcde4432 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:12.145561 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ee4d5-7765-42a9-8480-97a0fcde4432 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:12.150933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88716df0-2961-4997-95a9-a38d8bb7135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:12.151994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716df0-2961-4997-95a9-a38d8bb7135a admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:12.152376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716df0-2961-4997-95a9-a38d8bb7135a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:12.152951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716df0-2961-4997-95a9-a38d8bb7135a admin admin] PATH_INFO: `/v3/projects/6e2d0d080f7448ff881c4012ee37c805/users/76f8a8b6af2d404e83abdd48c7fa73ce/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:12.172922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88716df0-2961-4997-95a9-a38d8bb7135a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2d0d080f7448ff881c4012ee37c805, user_id=76f8a8b6af2d404e83abdd48c7fa73ce, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:12.176696 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88716df0-2961-4997-95a9-a38d8bb7135a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:12.257229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1273/2526] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:12 2022] PUT /identity/v3/projects/6e2d0d080f7448ff881c4012ee37c805/users/76f8a8b6af2d404e83abdd48c7fa73ce/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:12.261313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a258f2f-7a5a-4ac9-9cdc-2246b5f05319 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:12.278213 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a258f2f-7a5a-4ac9-9cdc-2246b5f05319 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:12.375591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b18feb-83b2-41ae-a173-cdb647050ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:12.376323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b18feb-83b2-41ae-a173-cdb647050ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:12.376605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b18feb-83b2-41ae-a173-cdb647050ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:12.376878 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b18feb-83b2-41ae-a173-cdb647050ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:12.382194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b18feb-83b2-41ae-a173-cdb647050ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:12.382194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b18feb-83b2-41ae-a173-cdb647050ca1 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:12.395434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88716df0-2961-4997-95a9-a38d8bb7135a admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:12.397475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1254/2527] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:12.406785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88716df0-2961-4997-95a9-a38d8bb7135a admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:12.411745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6eb40e-cdc8-4785-8eb1-5e162e25eb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:12.412680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eb40e-cdc8-4785-8eb1-5e162e25eb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:12.412969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eb40e-cdc8-4785-8eb1-5e162e25eb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:12.413248 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eb40e-cdc8-4785-8eb1-5e162e25eb23 admin admin] PATH_INFO: `/v3/projects/6e2d0d080f7448ff881c4012ee37c805/users/76f8a8b6af2d404e83abdd48c7fa73ce/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:12.415231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6eb40e-cdc8-4785-8eb1-5e162e25eb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2d0d080f7448ff881c4012ee37c805, user_id=76f8a8b6af2d404e83abdd48c7fa73ce, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:12.417988 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6eb40e-cdc8-4785-8eb1-5e162e25eb23 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:12.429703 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1274/2528] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:12 2022] PUT /identity/v3/projects/6e2d0d080f7448ff881c4012ee37c805/users/76f8a8b6af2d404e83abdd48c7fa73ce/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:29:12.440632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d008c5-7f57-4b82-a116-e74beb78eb00 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:12.440929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d008c5-7f57-4b82-a116-e74beb78eb00 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:12.441216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d008c5-7f57-4b82-a116-e74beb78eb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:12.468621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-23d008c5-7f57-4b82-a116-e74beb78eb00 None None] MFA Rules not processed for user `76f8a8b6af2d404e83abdd48c7fa73ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:12.469854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-23d008c5-7f57-4b82-a116-e74beb78eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:12.539903 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1255/2529] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:12.551027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6eb40e-cdc8-4785-8eb1-5e162e25eb23 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:12.552780 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ec6eb40e-cdc8-4785-8eb1-5e162e25eb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:12.612941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6eb40e-cdc8-4785-8eb1-5e162e25eb23 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:12.616792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b628ad6-6ed0-4738-9f22-29d7f2efee3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:12.617595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628ad6-6ed0-4738-9f22-29d7f2efee3b service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:12.617983 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628ad6-6ed0-4738-9f22-29d7f2efee3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:12.618361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628ad6-6ed0-4738-9f22-29d7f2efee3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:12.628001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b628ad6-6ed0-4738-9f22-29d7f2efee3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:12.629515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b628ad6-6ed0-4738-9f22-29d7f2efee3b service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:12.639458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1275/2530] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:12.753794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d008c5-7f57-4b82-a116-e74beb78eb00 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:12.764194 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d008c5-7f57-4b82-a116-e74beb78eb00 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:12.769325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58083e-3d75-44f5-81d0-6f2a21bfd113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:12.769531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58083e-3d75-44f5-81d0-6f2a21bfd113 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:12.769939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58083e-3d75-44f5-81d0-6f2a21bfd113 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:12.770067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58083e-3d75-44f5-81d0-6f2a21bfd113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:12.837583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58083e-3d75-44f5-81d0-6f2a21bfd113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:12.839067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58083e-3d75-44f5-81d0-6f2a21bfd113 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:12.852080 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1256/2531] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:15.356428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b628ad6-6ed0-4738-9f22-29d7f2efee3b service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:15.358386 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5b628ad6-6ed0-4738-9f22-29d7f2efee3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:15.390036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:15.447487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b628ad6-6ed0-4738-9f22-29d7f2efee3b service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:15.453539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:15.454450 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:15.454742 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:15.455017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] PATH_INFO: `/v3/users/fac722ebafd540b0b3fe05d83fa39c36` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:15.456321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac722ebafd540b0b3fe05d83fa39c36)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:15.458270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:15.676963 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac722ebafd540b0b3fe05d83fa39c36'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:15.760893 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac722ebafd540b0b3fe05d83fa39c36'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:15.777145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac722ebafd540b0b3fe05d83fa39c36'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:15.778177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac722ebafd540b0b3fe05d83fa39c36'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:15.788977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac722ebafd540b0b3fe05d83fa39c36'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:15.801454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1276/2532] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:29:15 2022] DELETE /identity/v3/users/fac722ebafd540b0b3fe05d83fa39c36 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:16.066122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58083e-3d75-44f5-81d0-6f2a21bfd113 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:16.093305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58083e-3d75-44f5-81d0-6f2a21bfd113 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:16.106444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:16.108297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:16.116039 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:16.181884 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:16.183126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.183600 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.183916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] PATH_INFO: `/v3/projects/81684485980545cda977f1d7e72f90e2` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.185555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] RBAC: Authorizing `identity:delete_project(project_id=81684485980545cda977f1d7e72f90e2)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:16.196115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:16.236120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d299fa-03ce-4dcd-914d-cbfe1cddcd91 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:16.242010 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:16.242757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.243145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.243702 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] PATH_INFO: `/v3/users/6f443849ff354c9491a393b0dc759c0b` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.245383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f443849ff354c9491a393b0dc759c0b)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:16.247552 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:16.314776 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81684485980545cda977f1d7e72f90e2', 'request_id': 'req-ede30184-ead1-49f9-bbd4-3e7b81a8187b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.323203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81684485980545cda977f1d7e72f90e2', 'request_id': 'req-ede30184-ead1-49f9-bbd4-3e7b81a8187b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.479865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81684485980545cda977f1d7e72f90e2', 'request_id': 'req-ede30184-ead1-49f9-bbd4-3e7b81a8187b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.492088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] The token cache is being invalidate because project 81684485980545cda977f1d7e72f90e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:16.492382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.493081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.494691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1257/2533] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:16 2022] DELETE /identity/v3/projects/81684485980545cda977f1d7e72f90e2 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:16.498683 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:16.500667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:16.538039 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:16.548803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f443849ff354c9491a393b0dc759c0b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.576081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede30184-ead1-49f9-bbd4-3e7b81a8187b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:16.581351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:16.582265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.582558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.582843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] PATH_INFO: `/v3/users/e9e100eb0fdd4625be1a116e8bcf7576` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.584260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e100eb0fdd4625be1a116e8bcf7576)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:16.586246 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:16.617940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f443849ff354c9491a393b0dc759c0b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.635070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f443849ff354c9491a393b0dc759c0b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.635995 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f443849ff354c9491a393b0dc759c0b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.643643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-34603a82-50e0-4c44-89d7-70cf096913e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f443849ff354c9491a393b0dc759c0b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.650330 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1277/2534] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:29:16 2022] DELETE /identity/v3/users/6f443849ff354c9491a393b0dc759c0b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:16.655255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af331fac-89ef-4f56-99e7-a3c49119e9ac None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.655624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af331fac-89ef-4f56-99e7-a3c49119e9ac None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.655942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af331fac-89ef-4f56-99e7-a3c49119e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.676336 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-af331fac-89ef-4f56-99e7-a3c49119e9ac None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:16.677556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-af331fac-89ef-4f56-99e7-a3c49119e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:16.746566 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1278/2535] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:29:16.756467 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af331fac-89ef-4f56-99e7-a3c49119e9ac None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:16.757864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-af331fac-89ef-4f56-99e7-a3c49119e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:16.817515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af331fac-89ef-4f56-99e7-a3c49119e9ac None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:16.821353 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25368c-2877-4df6-9da4-dfd4d8a36e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:16.822027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25368c-2877-4df6-9da4-dfd4d8a36e23 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.822314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25368c-2877-4df6-9da4-dfd4d8a36e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.822588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25368c-2877-4df6-9da4-dfd4d8a36e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.833581 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25368c-2877-4df6-9da4-dfd4d8a36e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:16.835301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25368c-2877-4df6-9da4-dfd4d8a36e23 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:16.840012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:16.842634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e100eb0fdd4625be1a116e8bcf7576'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.847622 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1279/2536] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:29:16.895981 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e100eb0fdd4625be1a116e8bcf7576'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.912410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e100eb0fdd4625be1a116e8bcf7576'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.913517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e100eb0fdd4625be1a116e8bcf7576'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.922430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e100eb0fdd4625be1a116e8bcf7576'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:16.932463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1258/2537] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:29:16 2022] DELETE /identity/v3/users/e9e100eb0fdd4625be1a116e8bcf7576 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:29:17.218817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25368c-2877-4df6-9da4-dfd4d8a36e23 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:17.220382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0f25368c-2877-4df6-9da4-dfd4d8a36e23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:17.234106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25368c-2877-4df6-9da4-dfd4d8a36e23 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:17.287588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:17.292870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:17.294443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:17.296306 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:17.297251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:17.297538 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:17.297814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] PATH_INFO: `/v3/projects/e14fe1dee95146a59f3b90f9eb16eb69` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:17.299027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14fe1dee95146a59f3b90f9eb16eb69)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:17.301228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:17.310952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445414d-9b12-4fdf-b99d-75c70ae8f944 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:17.319005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:17.320009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:17.320363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:17.320650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] PATH_INFO: `/v3/projects/8fed292392f8410fb92e2ae0222d05e8` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:17.322140 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fed292392f8410fb92e2ae0222d05e8)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:17.324370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:17.441918 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14fe1dee95146a59f3b90f9eb16eb69', 'request_id': 'req-599aaf3b-994d-4744-bc1f-0c7008739478'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:17.442192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fed292392f8410fb92e2ae0222d05e8', 'request_id': 'req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:17.448941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fed292392f8410fb92e2ae0222d05e8', 'request_id': 'req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:17.449151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14fe1dee95146a59f3b90f9eb16eb69', 'request_id': 'req-599aaf3b-994d-4744-bc1f-0c7008739478'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:17.513942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14fe1dee95146a59f3b90f9eb16eb69', 'request_id': 'req-599aaf3b-994d-4744-bc1f-0c7008739478'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:17.525824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] The token cache is being invalidate because project e14fe1dee95146a59f3b90f9eb16eb69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:17.526112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:17.526750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:17.528331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1280/2538] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:17 2022] DELETE /identity/v3/projects/e14fe1dee95146a59f3b90f9eb16eb69 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:17.565574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fed292392f8410fb92e2ae0222d05e8', 'request_id': 'req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:17.578794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] The token cache is being invalidate because project 8fed292392f8410fb92e2ae0222d05e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:17.579091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:17.579796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:17.581666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1259/2539] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:17 2022] DELETE /identity/v3/projects/8fed292392f8410fb92e2ae0222d05e8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:29:17.585969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:17.592873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:17.666990 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aaf3b-994d-4744-bc1f-0c7008739478 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:17.745397 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:17.746424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:17.746786 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:17.747133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] PATH_INFO: `/v3/users/76f8a8b6af2d404e83abdd48c7fa73ce` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:17.748930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f8a8b6af2d404e83abdd48c7fa73ce)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:17.751548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:17.931102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:17.939822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f8a8b6af2d404e83abdd48c7fa73ce'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:18.045216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f8a8b6af2d404e83abdd48c7fa73ce'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:18.058471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f8a8b6af2d404e83abdd48c7fa73ce'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:18.059166 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f8a8b6af2d404e83abdd48c7fa73ce'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:18.066501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-15f8f312-1415-4df3-a56c-5ded7367f420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f8a8b6af2d404e83abdd48c7fa73ce'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:18.072638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1281/2540] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:29:17 2022] DELETE /identity/v3/users/76f8a8b6af2d404e83abdd48c7fa73ce => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:18.481115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:18.482589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:18.496412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3e276-5ae7-49e4-aa3c-79992ad3cd4b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:18.553846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:18.554704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:18.554990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:18.555266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] PATH_INFO: `/v3/projects/6e2d0d080f7448ff881c4012ee37c805` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:18.556473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2d0d080f7448ff881c4012ee37c805)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:18.558431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:18.653991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:18.657507 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2d0d080f7448ff881c4012ee37c805', 'request_id': 'req-8657fb49-7aa5-4e5f-8687-ed94fb884596'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:18.663774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2d0d080f7448ff881c4012ee37c805', 'request_id': 'req-8657fb49-7aa5-4e5f-8687-ed94fb884596'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:18.736418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2d0d080f7448ff881c4012ee37c805', 'request_id': 'req-8657fb49-7aa5-4e5f-8687-ed94fb884596'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:18.747000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] The token cache is being invalidate because project 6e2d0d080f7448ff881c4012ee37c805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:18.747288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:18.747937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8657fb49-7aa5-4e5f-8687-ed94fb884596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:18.749495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1260/2541] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:18 2022] DELETE /identity/v3/projects/6e2d0d080f7448ff881c4012ee37c805 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:18.754401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e7e2-e7ec-44cd-a8b5-52f94d6284aa None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:18.754871 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e7e2-e7ec-44cd-a8b5-52f94d6284aa None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:18.754969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e7e2-e7ec-44cd-a8b5-52f94d6284aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:18.773050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-0ba0e7e2-e7ec-44cd-a8b5-52f94d6284aa None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:18.774260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0ba0e7e2-e7ec-44cd-a8b5-52f94d6284aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:18.831863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1282/2542] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:18.841064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e852e9-1efa-4422-bba6-e5a8c66d3e4e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:18.841355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e852e9-1efa-4422-bba6-e5a8c66d3e4e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:18.841635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e852e9-1efa-4422-bba6-e5a8c66d3e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:18.860420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-08e852e9-1efa-4422-bba6-e5a8c66d3e4e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:18.861628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-08e852e9-1efa-4422-bba6-e5a8c66d3e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:18.869445 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1261/2543] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:18.873623 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e7e2-e7ec-44cd-a8b5-52f94d6284aa None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:18.883316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e7e2-e7ec-44cd-a8b5-52f94d6284aa None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:18.887812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585125d-5816-41ba-89e7-825040579ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:18.888498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585125d-5816-41ba-89e7-825040579ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:18.888781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585125d-5816-41ba-89e7-825040579ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:18.889057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585125d-5816-41ba-89e7-825040579ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:18.890292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585125d-5816-41ba-89e7-825040579ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:18.890601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585125d-5816-41ba-89e7-825040579ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:18.892246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585125d-5816-41ba-89e7-825040579ef6 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:18.903531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1283/2544] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:18.908560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e852e9-1efa-4422-bba6-e5a8c66d3e4e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:18.917606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e852e9-1efa-4422-bba6-e5a8c66d3e4e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:18.922159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498fa3e-2658-4f09-9bae-1e672dce8e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:18.922802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498fa3e-2658-4f09-9bae-1e672dce8e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:18.923084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498fa3e-2658-4f09-9bae-1e672dce8e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:18.923357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498fa3e-2658-4f09-9bae-1e672dce8e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:18.924075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498fa3e-2658-4f09-9bae-1e672dce8e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:18.925955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498fa3e-2658-4f09-9bae-1e672dce8e86 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.012266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1262/2545] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:29:18 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:19.016900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585125d-5816-41ba-89e7-825040579ef6 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:19.026954 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585125d-5816-41ba-89e7-825040579ef6 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:19.083109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c71285-6f3d-48c6-b58b-0cac7f5010d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:19.083785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71285-6f3d-48c6-b58b-0cac7f5010d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.084104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71285-6f3d-48c6-b58b-0cac7f5010d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.084385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71285-6f3d-48c6-b58b-0cac7f5010d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.085087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c71285-6f3d-48c6-b58b-0cac7f5010d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:19.087295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c71285-6f3d-48c6-b58b-0cac7f5010d4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.159631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1284/2546] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:29:19 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:19.163688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498fa3e-2658-4f09-9bae-1e672dce8e86 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:19.174305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498fa3e-2658-4f09-9bae-1e672dce8e86 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:19.179028 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6e4b6-3042-4ca6-b020-d374158717dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:19.179690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6e4b6-3042-4ca6-b020-d374158717dd admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.180009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6e4b6-3042-4ca6-b020-d374158717dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.180289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6e4b6-3042-4ca6-b020-d374158717dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.181102 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6e4b6-3042-4ca6-b020-d374158717dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:19.182696 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6e4b6-3042-4ca6-b020-d374158717dd admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.193704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1263/2547] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:19.197829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c71285-6f3d-48c6-b58b-0cac7f5010d4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:19.208710 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c71285-6f3d-48c6-b58b-0cac7f5010d4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:19.214119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d68c7-65fa-4487-9576-ebfa776bf2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:19.214853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d68c7-65fa-4487-9576-ebfa776bf2ab admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.215140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d68c7-65fa-4487-9576-ebfa776bf2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.215415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d68c7-65fa-4487-9576-ebfa776bf2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.216193 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d68c7-65fa-4487-9576-ebfa776bf2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:19.222031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d68c7-65fa-4487-9576-ebfa776bf2ab admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.228088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1285/2548] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:19.232414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6e4b6-3042-4ca6-b020-d374158717dd admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:19.242495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6e4b6-3042-4ca6-b020-d374158717dd admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:19.247089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb148c-c95a-425f-a734-861fff972768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:19.248004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb148c-c95a-425f-a734-861fff972768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.248289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb148c-c95a-425f-a734-861fff972768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.248565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb148c-c95a-425f-a734-861fff972768 admin admin] PATH_INFO: `/v3/projects/9222e68262ce4a1f996c1aef5c314e78/users/c9c86c8f3b7b441197fee1e6fd3bfc0a/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.263483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb148c-c95a-425f-a734-861fff972768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9222e68262ce4a1f996c1aef5c314e78, user_id=c9c86c8f3b7b441197fee1e6fd3bfc0a, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:19.266671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb148c-c95a-425f-a734-861fff972768 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.331382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1264/2549] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:19 2022] PUT /identity/v3/projects/9222e68262ce4a1f996c1aef5c314e78/users/c9c86c8f3b7b441197fee1e6fd3bfc0a/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:19.341965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073687c-8ebb-41e4-8d61-80f0d80f64b1 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.342257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073687c-8ebb-41e4-8d61-80f0d80f64b1 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.346198 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073687c-8ebb-41e4-8d61-80f0d80f64b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.369507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4073687c-8ebb-41e4-8d61-80f0d80f64b1 None None] MFA Rules not processed for user `c9c86c8f3b7b441197fee1e6fd3bfc0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:19.370740 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4073687c-8ebb-41e4-8d61-80f0d80f64b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:19.379837 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:19.436014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1286/2550] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:19.441009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb148c-c95a-425f-a734-861fff972768 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:19.504201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb148c-c95a-425f-a734-861fff972768 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:19.508958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c3d61-94c4-4c3a-9bbd-5d864ccff769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:19.509618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c3d61-94c4-4c3a-9bbd-5d864ccff769 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.509903 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c3d61-94c4-4c3a-9bbd-5d864ccff769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.510181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c3d61-94c4-4c3a-9bbd-5d864ccff769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.510864 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c3d61-94c4-4c3a-9bbd-5d864ccff769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:19.512795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c3d61-94c4-4c3a-9bbd-5d864ccff769 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.584101 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1265/2551] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:29:19 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:19.588687 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073687c-8ebb-41e4-8d61-80f0d80f64b1 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:19.599472 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073687c-8ebb-41e4-8d61-80f0d80f64b1 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:19.655669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ade2d3-b00e-4883-9f51-77882296558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:19.656373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ade2d3-b00e-4883-9f51-77882296558c admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.656662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ade2d3-b00e-4883-9f51-77882296558c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.656940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ade2d3-b00e-4883-9f51-77882296558c admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.657978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ade2d3-b00e-4883-9f51-77882296558c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:19.659972 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ade2d3-b00e-4883-9f51-77882296558c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.759560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1287/2552] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:29:19 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:19.763658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c3d61-94c4-4c3a-9bbd-5d864ccff769 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:19.774528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c3d61-94c4-4c3a-9bbd-5d864ccff769 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:19.779379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5746670-b7bd-4f56-b3ce-b2e610ccb7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:19.780086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5746670-b7bd-4f56-b3ce-b2e610ccb7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.780371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5746670-b7bd-4f56-b3ce-b2e610ccb7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.780649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5746670-b7bd-4f56-b3ce-b2e610ccb7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.781407 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5746670-b7bd-4f56-b3ce-b2e610ccb7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:19.782994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5746670-b7bd-4f56-b3ce-b2e610ccb7d9 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.795390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1266/2553] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:19.799826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ade2d3-b00e-4883-9f51-77882296558c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:19.810505 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ade2d3-b00e-4883-9f51-77882296558c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:19.815944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f945e6f-0814-4684-bede-9cddb40e0f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:19.816639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945e6f-0814-4684-bede-9cddb40e0f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.816921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945e6f-0814-4684-bede-9cddb40e0f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.817190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945e6f-0814-4684-bede-9cddb40e0f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.817915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f945e6f-0814-4684-bede-9cddb40e0f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:19.819517 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f945e6f-0814-4684-bede-9cddb40e0f3c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.829942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1288/2554] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:19.834266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5746670-b7bd-4f56-b3ce-b2e610ccb7d9 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:19.844792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5746670-b7bd-4f56-b3ce-b2e610ccb7d9 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:19.849334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82451c39-c469-46f8-8090-cc969c1a5060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:19.850211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82451c39-c469-46f8-8090-cc969c1a5060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.850493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82451c39-c469-46f8-8090-cc969c1a5060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.850768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82451c39-c469-46f8-8090-cc969c1a5060 admin admin] PATH_INFO: `/v3/projects/37e431fa4171438d94907454348ca10e/users/f13209fdc8524b0d846f765c2d96aef3/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.865799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82451c39-c469-46f8-8090-cc969c1a5060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e431fa4171438d94907454348ca10e, user_id=f13209fdc8524b0d846f765c2d96aef3, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:19.868495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82451c39-c469-46f8-8090-cc969c1a5060 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.964818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1267/2555] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:19 2022] PUT /identity/v3/projects/37e431fa4171438d94907454348ca10e/users/f13209fdc8524b0d846f765c2d96aef3/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:29:19.975568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79b158-978e-4633-9aa9-b03a3e9e560b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.975861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79b158-978e-4633-9aa9-b03a3e9e560b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.976173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79b158-978e-4633-9aa9-b03a3e9e560b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:20.002544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-9c79b158-978e-4633-9aa9-b03a3e9e560b None None] MFA Rules not processed for user `f13209fdc8524b0d846f765c2d96aef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:20.003814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9c79b158-978e-4633-9aa9-b03a3e9e560b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:20.066224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1289/2556] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:20.070710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82451c39-c469-46f8-8090-cc969c1a5060 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:20.091396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:20.133191 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82451c39-c469-46f8-8090-cc969c1a5060 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:20.137909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a842e4e-a9a8-45eb-81b3-5f918a57119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:20.138566 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a842e4e-a9a8-45eb-81b3-5f918a57119f admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:20.138852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a842e4e-a9a8-45eb-81b3-5f918a57119f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:20.139131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a842e4e-a9a8-45eb-81b3-5f918a57119f admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:20.139852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a842e4e-a9a8-45eb-81b3-5f918a57119f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:20.141837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a842e4e-a9a8-45eb-81b3-5f918a57119f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:20.241447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1268/2557] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:29:20 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:29:20.245540 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79b158-978e-4633-9aa9-b03a3e9e560b None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:20.256523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79b158-978e-4633-9aa9-b03a3e9e560b None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:20.269224 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:20.311235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c81b1-e3b7-4322-9d43-a72db51a90fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:20.311946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c81b1-e3b7-4322-9d43-a72db51a90fb admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:20.312233 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c81b1-e3b7-4322-9d43-a72db51a90fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:20.313076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c81b1-e3b7-4322-9d43-a72db51a90fb admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:20.314293 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c81b1-e3b7-4322-9d43-a72db51a90fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:20.316338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c81b1-e3b7-4322-9d43-a72db51a90fb admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:20.428675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1290/2558] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:29:20 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:20.432658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a842e4e-a9a8-45eb-81b3-5f918a57119f admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:20.442876 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a842e4e-a9a8-45eb-81b3-5f918a57119f admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:20.447490 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa88a35-5f71-4974-990e-2880f2743a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:20.448183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa88a35-5f71-4974-990e-2880f2743a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:20.448465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa88a35-5f71-4974-990e-2880f2743a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:20.448739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa88a35-5f71-4974-990e-2880f2743a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:20.449502 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa88a35-5f71-4974-990e-2880f2743a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:20.451085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa88a35-5f71-4974-990e-2880f2743a6b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:20.466100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1269/2559] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:20.470856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c81b1-e3b7-4322-9d43-a72db51a90fb admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:20.480929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c81b1-e3b7-4322-9d43-a72db51a90fb admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:20.485554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552601a-7d29-4497-a608-90cd7d3612fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:20.486434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552601a-7d29-4497-a608-90cd7d3612fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:20.486720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552601a-7d29-4497-a608-90cd7d3612fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:20.487001 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552601a-7d29-4497-a608-90cd7d3612fb admin admin] PATH_INFO: `/v3/projects/d36966dde9c04acab39d54301dbd9874/users/a3ea4b3698c4460d961c016b94dd823b/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:20.501533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552601a-7d29-4497-a608-90cd7d3612fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36966dde9c04acab39d54301dbd9874, user_id=a3ea4b3698c4460d961c016b94dd823b, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:20.504245 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552601a-7d29-4497-a608-90cd7d3612fb admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:20.571247 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1291/2560] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:20 2022] PUT /identity/v3/projects/d36966dde9c04acab39d54301dbd9874/users/a3ea4b3698c4460d961c016b94dd823b/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:20.575410 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa88a35-5f71-4974-990e-2880f2743a6b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:20.586447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa88a35-5f71-4974-990e-2880f2743a6b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:20.643185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a51f4-fe94-429a-9773-abaaa0799c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:20.643852 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a51f4-fe94-429a-9773-abaaa0799c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:20.644218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a51f4-fe94-429a-9773-abaaa0799c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:20.644453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a51f4-fe94-429a-9773-abaaa0799c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:20.649496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a51f4-fe94-429a-9773-abaaa0799c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:20.649496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a51f4-fe94-429a-9773-abaaa0799c6a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:20.656929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1270/2561] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:20.661189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552601a-7d29-4497-a608-90cd7d3612fb admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:20.672013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552601a-7d29-4497-a608-90cd7d3612fb admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:20.676669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e463d-3e60-4cf4-b0b0-900c690a075b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:20.677549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e463d-3e60-4cf4-b0b0-900c690a075b admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:20.677833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e463d-3e60-4cf4-b0b0-900c690a075b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:20.678110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e463d-3e60-4cf4-b0b0-900c690a075b admin admin] PATH_INFO: `/v3/projects/d36966dde9c04acab39d54301dbd9874/users/a3ea4b3698c4460d961c016b94dd823b/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:20.680096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e463d-3e60-4cf4-b0b0-900c690a075b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36966dde9c04acab39d54301dbd9874, user_id=a3ea4b3698c4460d961c016b94dd823b, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:20.682722 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e463d-3e60-4cf4-b0b0-900c690a075b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:20.692840 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1292/2562] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:20 2022] PUT /identity/v3/projects/d36966dde9c04acab39d54301dbd9874/users/a3ea4b3698c4460d961c016b94dd823b/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:20.757281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c881d9-16fb-466b-a6f8-c846aeb22ace None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:20.757671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c881d9-16fb-466b-a6f8-c846aeb22ace None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:20.758030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c881d9-16fb-466b-a6f8-c846aeb22ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:20.784826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-14c881d9-16fb-466b-a6f8-c846aeb22ace None None] MFA Rules not processed for user `a3ea4b3698c4460d961c016b94dd823b`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:20.786041 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-14c881d9-16fb-466b-a6f8-c846aeb22ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:20.851637 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1271/2563] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:20.863204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e463d-3e60-4cf4-b0b0-900c690a075b admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:20.865026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6b4e463d-3e60-4cf4-b0b0-900c690a075b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:20.920295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e463d-3e60-4cf4-b0b0-900c690a075b admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:20.924422 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773a23c-915c-4a83-b426-f4b5125ca74b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:20.925071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a23c-915c-4a83-b426-f4b5125ca74b service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:20.925355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a23c-915c-4a83-b426-f4b5125ca74b service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:20.925632 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a23c-915c-4a83-b426-f4b5125ca74b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:20.934513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773a23c-915c-4a83-b426-f4b5125ca74b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:20.935981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773a23c-915c-4a83-b426-f4b5125ca74b service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:20.945281 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1293/2564] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:21.041571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c881d9-16fb-466b-a6f8-c846aeb22ace None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:21.043005 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-14c881d9-16fb-466b-a6f8-c846aeb22ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:21.055267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c881d9-16fb-466b-a6f8-c846aeb22ace None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:21.058761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd766393-86f1-4216-8dc0-1ed73ba4c859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:21.059403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd766393-86f1-4216-8dc0-1ed73ba4c859 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:21.059684 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd766393-86f1-4216-8dc0-1ed73ba4c859 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:21.059995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd766393-86f1-4216-8dc0-1ed73ba4c859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:21.072133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:21.117657 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd766393-86f1-4216-8dc0-1ed73ba4c859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:21.119111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd766393-86f1-4216-8dc0-1ed73ba4c859 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:21.128532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1272/2565] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:25.225555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773a23c-915c-4a83-b426-f4b5125ca74b service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:25.287093 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773a23c-915c-4a83-b426-f4b5125ca74b service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:25.291650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:25.292548 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:25.292831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:25.293100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] PATH_INFO: `/v3/users/c9c86c8f3b7b441197fee1e6fd3bfc0a` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:25.294296 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c86c8f3b7b441197fee1e6fd3bfc0a)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:25.296263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:25.309752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:25.459584 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c86c8f3b7b441197fee1e6fd3bfc0a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:25.513709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c86c8f3b7b441197fee1e6fd3bfc0a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:25.526187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c86c8f3b7b441197fee1e6fd3bfc0a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:25.526826 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c86c8f3b7b441197fee1e6fd3bfc0a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:25.533645 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c86c8f3b7b441197fee1e6fd3bfc0a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:25.539651 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1294/2566] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:29:25 2022] DELETE /identity/v3/users/c9c86c8f3b7b441197fee1e6fd3bfc0a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:25.544199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67f970-d8ed-4234-803e-76cc55e58c4c None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:25.544660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67f970-d8ed-4234-803e-76cc55e58c4c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:25.544755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67f970-d8ed-4234-803e-76cc55e58c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:25.562942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9b67f970-d8ed-4234-803e-76cc55e58c4c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:25.564177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9b67f970-d8ed-4234-803e-76cc55e58c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:25.622321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1273/2567] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:25.632589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:25.634000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:25.690877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b858ee-eb21-4f47-bdcc-010bc784a846 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:25.694613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecfc0d-6ac6-4ada-94c4-4ac11626ed85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:25.695267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecfc0d-6ac6-4ada-94c4-4ac11626ed85 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:25.695553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecfc0d-6ac6-4ada-94c4-4ac11626ed85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:25.695831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecfc0d-6ac6-4ada-94c4-4ac11626ed85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:25.705650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecfc0d-6ac6-4ada-94c4-4ac11626ed85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:25.707098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecfc0d-6ac6-4ada-94c4-4ac11626ed85 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:25.717049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1295/2568] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:26.167760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67f970-d8ed-4234-803e-76cc55e58c4c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:26.173388 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9b67f970-d8ed-4234-803e-76cc55e58c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:26.189040 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67f970-d8ed-4234-803e-76cc55e58c4c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:26.194203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:26.195108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:26.195390 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:26.195708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] PATH_INFO: `/v3/projects/9222e68262ce4a1f996c1aef5c314e78` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:26.196993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9222e68262ce4a1f996c1aef5c314e78)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:26.198905 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:26.329100 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9222e68262ce4a1f996c1aef5c314e78', 'request_id': 'req-e0894b11-427f-4e9b-8b6c-1cd5901ad860'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:26.335431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9222e68262ce4a1f996c1aef5c314e78', 'request_id': 'req-e0894b11-427f-4e9b-8b6c-1cd5901ad860'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:26.398267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9222e68262ce4a1f996c1aef5c314e78', 'request_id': 'req-e0894b11-427f-4e9b-8b6c-1cd5901ad860'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:26.410908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] The token cache is being invalidate because project 9222e68262ce4a1f996c1aef5c314e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:26.411096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:26.411757 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:26.413350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1274/2569] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:26 2022] DELETE /identity/v3/projects/9222e68262ce4a1f996c1aef5c314e78 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:26.417370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecfc0d-6ac6-4ada-94c4-4ac11626ed85 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:26.428303 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecfc0d-6ac6-4ada-94c4-4ac11626ed85 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:26.485996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:26.486885 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:26.487165 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:26.487438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] PATH_INFO: `/v3/users/f13209fdc8524b0d846f765c2d96aef3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:26.488668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13209fdc8524b0d846f765c2d96aef3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:26.490631 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:26.644531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:26.652991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13209fdc8524b0d846f765c2d96aef3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:26.736686 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13209fdc8524b0d846f765c2d96aef3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:26.748827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13209fdc8524b0d846f765c2d96aef3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:26.749574 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13209fdc8524b0d846f765c2d96aef3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:26.756137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13209fdc8524b0d846f765c2d96aef3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:26.761943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1296/2570] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:29:26 2022] DELETE /identity/v3/users/f13209fdc8524b0d846f765c2d96aef3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:27.165424 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:27.166928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:27.183210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0894b11-427f-4e9b-8b6c-1cd5901ad860 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:27.220520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:27.243977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:27.244855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:27.245141 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:27.245955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] PATH_INFO: `/v3/projects/37e431fa4171438d94907454348ca10e` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:27.247208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e431fa4171438d94907454348ca10e)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:27.249849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:27.372506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e431fa4171438d94907454348ca10e', 'request_id': 'req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:27.378739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e431fa4171438d94907454348ca10e', 'request_id': 'req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:27.450433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e431fa4171438d94907454348ca10e', 'request_id': 'req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:27.461160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] The token cache is being invalidate because project 37e431fa4171438d94907454348ca10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:27.461443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:27.462315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:27.463846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1275/2571] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:27 2022] DELETE /identity/v3/projects/37e431fa4171438d94907454348ca10e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:27.468507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:27.469924 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:27.482359 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce6eb-2fbd-4361-9b03-ebda5113cd1a admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:27.536933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:27.537726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:27.538009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:27.538283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] PATH_INFO: `/v3/users/a3ea4b3698c4460d961c016b94dd823b` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:27.539454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ea4b3698c4460d961c016b94dd823b)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:27.541400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:27.767208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ea4b3698c4460d961c016b94dd823b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:27.833862 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ea4b3698c4460d961c016b94dd823b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:27.846690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ea4b3698c4460d961c016b94dd823b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:27.847318 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ea4b3698c4460d961c016b94dd823b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:27.854049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-98f66011-81f5-491f-84ea-c8bff074eb3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ea4b3698c4460d961c016b94dd823b'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:27.863373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1297/2572] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:29:27 2022] DELETE /identity/v3/users/a3ea4b3698c4460d961c016b94dd823b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:29:28.258623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:28.260316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:28.274356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66843bc2-5c86-46ee-a6c8-cf408fcc76f5 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:28.331742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:28.332639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:28.332928 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:28.333210 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] PATH_INFO: `/v3/projects/d36966dde9c04acab39d54301dbd9874` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:28.334409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36966dde9c04acab39d54301dbd9874)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:28.336383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:28.457430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36966dde9c04acab39d54301dbd9874', 'request_id': 'req-56aca2f3-05d3-4a89-987c-f45eb40541d1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:28.463855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36966dde9c04acab39d54301dbd9874', 'request_id': 'req-56aca2f3-05d3-4a89-987c-f45eb40541d1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:28.519234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36966dde9c04acab39d54301dbd9874', 'request_id': 'req-56aca2f3-05d3-4a89-987c-f45eb40541d1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:28.526218 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:28.530698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] The token cache is being invalidate because project d36966dde9c04acab39d54301dbd9874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:28.531007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:28.531617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-56aca2f3-05d3-4a89-987c-f45eb40541d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:28.533197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1276/2573] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:28 2022] DELETE /identity/v3/projects/d36966dde9c04acab39d54301dbd9874 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:28.539624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eebfb-010a-4acb-8d6d-4a059928e418 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:28.540121 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eebfb-010a-4acb-8d6d-4a059928e418 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:28.540216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eebfb-010a-4acb-8d6d-4a059928e418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:28.558854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8d0eebfb-010a-4acb-8d6d-4a059928e418 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:28.560097 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8d0eebfb-010a-4acb-8d6d-4a059928e418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:28.590069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:28.620382 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1298/2574] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:28.629489 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8e73-f6a9-48e7-ba28-bc9d845ca4e4 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:28.629786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8e73-f6a9-48e7-ba28-bc9d845ca4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:28.630073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8e73-f6a9-48e7-ba28-bc9d845ca4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:28.648873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0bfe8e73-f6a9-48e7-ba28-bc9d845ca4e4 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:28.650024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0bfe8e73-f6a9-48e7-ba28-bc9d845ca4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:28.658474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1277/2575] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:29:28.662775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eebfb-010a-4acb-8d6d-4a059928e418 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:28.672316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eebfb-010a-4acb-8d6d-4a059928e418 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:28.676888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a16b2c-4c82-4863-beac-845532b5ec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:28.677767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a16b2c-4c82-4863-beac-845532b5ec5f admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:28.678275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a16b2c-4c82-4863-beac-845532b5ec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:28.678890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a16b2c-4c82-4863-beac-845532b5ec5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:28.679640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a16b2c-4c82-4863-beac-845532b5ec5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:29:28.680056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a16b2c-4c82-4863-beac-845532b5ec5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:28.681666 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a16b2c-4c82-4863-beac-845532b5ec5f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:28.693514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1299/2576] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:29:28.697865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8e73-f6a9-48e7-ba28-bc9d845ca4e4 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:28.707634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8e73-f6a9-48e7-ba28-bc9d845ca4e4 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:28.712654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7edb2c-ae73-47f7-adde-005ed2511b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:28.713304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7edb2c-ae73-47f7-adde-005ed2511b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:28.713594 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7edb2c-ae73-47f7-adde-005ed2511b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:28.713873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7edb2c-ae73-47f7-adde-005ed2511b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:28.714567 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7edb2c-ae73-47f7-adde-005ed2511b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:28.716568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7edb2c-ae73-47f7-adde-005ed2511b37 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:28.828042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1278/2577] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:29:28 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:28.832155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a16b2c-4c82-4863-beac-845532b5ec5f admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:28.842592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a16b2c-4c82-4863-beac-845532b5ec5f admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:28.900314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade63c4c-ca03-4117-bf8c-c21a47335b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:28.900916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63c4c-ca03-4117-bf8c-c21a47335b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:28.901200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63c4c-ca03-4117-bf8c-c21a47335b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:28.901477 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63c4c-ca03-4117-bf8c-c21a47335b5c admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:28.902181 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade63c4c-ca03-4117-bf8c-c21a47335b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:28.904175 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade63c4c-ca03-4117-bf8c-c21a47335b5c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:29.009926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1300/2578] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:29:28 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:29:29.013997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7edb2c-ae73-47f7-adde-005ed2511b37 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:29.024096 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7edb2c-ae73-47f7-adde-005ed2511b37 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:29.028795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da368939-9abd-4957-9e2b-15f61973708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:29.029458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da368939-9abd-4957-9e2b-15f61973708d admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:29.029745 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da368939-9abd-4957-9e2b-15f61973708d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:29.030026 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da368939-9abd-4957-9e2b-15f61973708d admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:29.031334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da368939-9abd-4957-9e2b-15f61973708d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:29.032966 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da368939-9abd-4957-9e2b-15f61973708d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:29.044354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1279/2579] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:29.048902 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade63c4c-ca03-4117-bf8c-c21a47335b5c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:29.059131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade63c4c-ca03-4117-bf8c-c21a47335b5c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:29.063763 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7965d-a95c-4f00-b044-588cc8ff7baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:29.064445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7965d-a95c-4f00-b044-588cc8ff7baa admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:29.064733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7965d-a95c-4f00-b044-588cc8ff7baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:29.065011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7965d-a95c-4f00-b044-588cc8ff7baa admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:29.065738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7965d-a95c-4f00-b044-588cc8ff7baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:29.067327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7965d-a95c-4f00-b044-588cc8ff7baa admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:29.077283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1301/2580] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:29:29.081454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da368939-9abd-4957-9e2b-15f61973708d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:29.091463 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da368939-9abd-4957-9e2b-15f61973708d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:29.096584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e09043-68b3-4320-ac49-84d27fc9fc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:29.097446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e09043-68b3-4320-ac49-84d27fc9fc18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:29.097729 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e09043-68b3-4320-ac49-84d27fc9fc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:29.098003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e09043-68b3-4320-ac49-84d27fc9fc18 admin admin] PATH_INFO: `/v3/projects/093c55f2a24b40d4a9dd84ced19e2e3f/users/be0c7fd0bcd7413a8b4aaed317c586bf/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:29.112830 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e09043-68b3-4320-ac49-84d27fc9fc18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093c55f2a24b40d4a9dd84ced19e2e3f, user_id=be0c7fd0bcd7413a8b4aaed317c586bf, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:29.115458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e09043-68b3-4320-ac49-84d27fc9fc18 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:29.182521 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1280/2581] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:29:29 2022] PUT /identity/v3/projects/093c55f2a24b40d4a9dd84ced19e2e3f/users/be0c7fd0bcd7413a8b4aaed317c586bf/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:29.193417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898985ce-1181-44ea-bf5c-af48d3d2a780 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:29.193725 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898985ce-1181-44ea-bf5c-af48d3d2a780 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:29.193979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898985ce-1181-44ea-bf5c-af48d3d2a780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:29.223388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-898985ce-1181-44ea-bf5c-af48d3d2a780 None None] MFA Rules not processed for user `be0c7fd0bcd7413a8b4aaed317c586bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:29.224662 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-898985ce-1181-44ea-bf5c-af48d3d2a780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:29.287301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1302/2582] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:29.300428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e09043-68b3-4320-ac49-84d27fc9fc18 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:29.302199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-27e09043-68b3-4320-ac49-84d27fc9fc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:29.358031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e09043-68b3-4320-ac49-84d27fc9fc18 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:29.361722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da668ba0-9c27-4ca2-af9e-1a0f8a402702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:29.362370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da668ba0-9c27-4ca2-af9e-1a0f8a402702 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:29.362658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da668ba0-9c27-4ca2-af9e-1a0f8a402702 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:29.362936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da668ba0-9c27-4ca2-af9e-1a0f8a402702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:29.371180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da668ba0-9c27-4ca2-af9e-1a0f8a402702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:29.372638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da668ba0-9c27-4ca2-af9e-1a0f8a402702 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:29.381513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1281/2583] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:32.393029 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898985ce-1181-44ea-bf5c-af48d3d2a780 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:32.424370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:32.455466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898985ce-1181-44ea-bf5c-af48d3d2a780 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:32.460100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:32.461182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:32.461898 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:32.462560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] PATH_INFO: `/v3/users/be0c7fd0bcd7413a8b4aaed317c586bf` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:32.463827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0c7fd0bcd7413a8b4aaed317c586bf)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:32.465783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:32.659394 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0c7fd0bcd7413a8b4aaed317c586bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:32.713389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0c7fd0bcd7413a8b4aaed317c586bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:32.726165 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0c7fd0bcd7413a8b4aaed317c586bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:32.726801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0c7fd0bcd7413a8b4aaed317c586bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:32.734935 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0c7fd0bcd7413a8b4aaed317c586bf'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:32.743028 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1303/2584] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:29:32 2022] DELETE /identity/v3/users/be0c7fd0bcd7413a8b4aaed317c586bf => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:32.747625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a9ba-6ebc-43d2-915c-89eee234bb74 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:32.748135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a9ba-6ebc-43d2-915c-89eee234bb74 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:32.748233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777a9ba-6ebc-43d2-915c-89eee234bb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:32.765056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-5777a9ba-6ebc-43d2-915c-89eee234bb74 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:32.766281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5777a9ba-6ebc-43d2-915c-89eee234bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:32.825012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1282/2585] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:32.834727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:32.836184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:32.892922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c87d-c199-4668-b060-2360e2bf5465 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:32.896674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea89c0-dcd4-4bd2-a95a-85e6fa58b7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:32.897331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea89c0-dcd4-4bd2-a95a-85e6fa58b7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:32.897614 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea89c0-dcd4-4bd2-a95a-85e6fa58b7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:32.897888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea89c0-dcd4-4bd2-a95a-85e6fa58b7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:32.907690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea89c0-dcd4-4bd2-a95a-85e6fa58b7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:32.909161 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea89c0-dcd4-4bd2-a95a-85e6fa58b7f7 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:32.919238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1304/2586] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:33.282334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777a9ba-6ebc-43d2-915c-89eee234bb74 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:33.284988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5777a9ba-6ebc-43d2-915c-89eee234bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:33.300654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777a9ba-6ebc-43d2-915c-89eee234bb74 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:33.305359 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:33.306239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:33.306519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:33.306821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] PATH_INFO: `/v3/projects/093c55f2a24b40d4a9dd84ced19e2e3f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:33.308137 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=093c55f2a24b40d4a9dd84ced19e2e3f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:33.309894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:33.440054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:33.451336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093c55f2a24b40d4a9dd84ced19e2e3f', 'request_id': 'req-481afb78-3412-4dcd-b1ef-71dec1faa5d1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:33.458064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093c55f2a24b40d4a9dd84ced19e2e3f', 'request_id': 'req-481afb78-3412-4dcd-b1ef-71dec1faa5d1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:33.508035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093c55f2a24b40d4a9dd84ced19e2e3f', 'request_id': 'req-481afb78-3412-4dcd-b1ef-71dec1faa5d1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:33.519231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] The token cache is being invalidate because project 093c55f2a24b40d4a9dd84ced19e2e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:29:33.519510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:33.520183 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:29:33.521758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1283/2587] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:29:33 2022] DELETE /identity/v3/projects/093c55f2a24b40d4a9dd84ced19e2e3f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:29:42.914804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=66,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:43.639737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:17.436167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea89c0-dcd4-4bd2-a95a-85e6fa58b7f7 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:17.445082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea89c0-dcd4-4bd2-a95a-85e6fa58b7f7 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:17.502804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c0dc0-8ea5-44c8-8428-fb4d29160022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:17.504389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c0dc0-8ea5-44c8-8428-fb4d29160022 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:17.504674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c0dc0-8ea5-44c8-8428-fb4d29160022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:17.504955 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c0dc0-8ea5-44c8-8428-fb4d29160022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:17.507411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-768c0dc0-8ea5-44c8-8428-fb4d29160022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:17.583439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c0dc0-8ea5-44c8-8428-fb4d29160022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:17.584930 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c0dc0-8ea5-44c8-8428-fb4d29160022 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:17.597139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1305/2588] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:18.782381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:18.784579 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:18.797131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481afb78-3412-4dcd-b1ef-71dec1faa5d1 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:18.801065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936cda-068c-4e97-8514-2825b1d7c301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:18.801722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936cda-068c-4e97-8514-2825b1d7c301 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:18.802009 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936cda-068c-4e97-8514-2825b1d7c301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:18.802290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936cda-068c-4e97-8514-2825b1d7c301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:18.804118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7e936cda-068c-4e97-8514-2825b1d7c301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:18.818373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e936cda-068c-4e97-8514-2825b1d7c301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:18.819827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e936cda-068c-4e97-8514-2825b1d7c301 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:18.832560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1284/2589] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:22.641339 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7bd2-0e0a-4703-9cf6-4a0f5ea2b953 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:22.641838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7bd2-0e0a-4703-9cf6-4a0f5ea2b953 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:22.641959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7bd2-0e0a-4703-9cf6-4a0f5ea2b953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:22.661709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f6fb7bd2-0e0a-4703-9cf6-4a0f5ea2b953 None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:22.662927 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f6fb7bd2-0e0a-4703-9cf6-4a0f5ea2b953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:22.722383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1306/2590] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:30:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:22.978367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae127b-b72c-4898-9ddd-1ee08baa7b23 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:22.978367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae127b-b72c-4898-9ddd-1ee08baa7b23 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:22.978367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae127b-b72c-4898-9ddd-1ee08baa7b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:22.994097 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c0ae127b-b72c-4898-9ddd-1ee08baa7b23 None None] MFA Rules not processed for user `14bd9be0202b433cb1fa8be6afee8ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:22.995315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c0ae127b-b72c-4898-9ddd-1ee08baa7b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:23.008946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb7bd2-0e0a-4703-9cf6-4a0f5ea2b953 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:23.010234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f6fb7bd2-0e0a-4703-9cf6-4a0f5ea2b953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:23.055198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1285/2591] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:30:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:23.059379 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:23.086507 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb7bd2-0e0a-4703-9cf6-4a0f5ea2b953 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:23.091664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc95d-41ea-4ba9-a2b7-9aa7581f0036 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:23.092389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc95d-41ea-4ba9-a2b7-9aa7581f0036 service swift] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:23.092673 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc95d-41ea-4ba9-a2b7-9aa7581f0036 service swift] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:23.092953 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc95d-41ea-4ba9-a2b7-9aa7581f0036 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:23.101735 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc95d-41ea-4ba9-a2b7-9aa7581f0036 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:23.103368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc95d-41ea-4ba9-a2b7-9aa7581f0036 service swift] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:23.123487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1307/2592] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:30:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:30:31.632291 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae127b-b72c-4898-9ddd-1ee08baa7b23 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:31.635615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c0ae127b-b72c-4898-9ddd-1ee08baa7b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:31.667990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae127b-b72c-4898-9ddd-1ee08baa7b23 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:31.675950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ad062-0345-48ce-8b03-6bcb860f89da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:31.676542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ad062-0345-48ce-8b03-6bcb860f89da service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:31.676832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ad062-0345-48ce-8b03-6bcb860f89da service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:31.677197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ad062-0345-48ce-8b03-6bcb860f89da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:31.679360 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-981ad062-0345-48ce-8b03-6bcb860f89da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:31.881925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ad062-0345-48ce-8b03-6bcb860f89da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:31.883974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ad062-0345-48ce-8b03-6bcb860f89da service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:31.929735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1286/2593] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:33.159173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=11 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:41.926301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=72 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:44.630375 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939c52-d576-4ded-9df6-46a9d916e1fe None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:44.634658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939c52-d576-4ded-9df6-46a9d916e1fe None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:44.634658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939c52-d576-4ded-9df6-46a9d916e1fe None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:44.634658 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1308/2594] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:44.640379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d1fe5-7071-4aec-96db-ebc80c47f0d5 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:44.640379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d1fe5-7071-4aec-96db-ebc80c47f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:44.640379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d1fe5-7071-4aec-96db-ebc80c47f0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:44.664818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-493d1fe5-7071-4aec-96db-ebc80c47f0d5 None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:44.666548 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-493d1fe5-7071-4aec-96db-ebc80c47f0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:44.681749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1287/2595] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:30:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:44.694957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2939c52-d576-4ded-9df6-46a9d916e1fe None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:44.696839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f2939c52-d576-4ded-9df6-46a9d916e1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:44.765700 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2939c52-d576-4ded-9df6-46a9d916e1fe None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:44.769970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55015745-bf04-49c1-bb82-83782683d686 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '979519f42f7d463bb2ee1d5b0bb72a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:44.770652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55015745-bf04-49c1-bb82-83782683d686 service glance] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:44.770932 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55015745-bf04-49c1-bb82-83782683d686 service glance] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:44.771297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55015745-bf04-49c1-bb82-83782683d686 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:44.784200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55015745-bf04-49c1-bb82-83782683d686 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:44.787920 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55015745-bf04-49c1-bb82-83782683d686 service glance] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:44.798781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1309/2596] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:30:45.017701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b901-97df-40dd-97fe-f8c70aa937a3 None None] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:45.017942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b901-97df-40dd-97fe-f8c70aa937a3 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:45.018222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b901-97df-40dd-97fe-f8c70aa937a3 None None] PATH_INFO: `/` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:45.019775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1288/2597] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:45.025220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c542b7f-e8df-4e13-b4a3-a694a4e6e958 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:45.025525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c542b7f-e8df-4e13-b4a3-a694a4e6e958 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:45.025783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c542b7f-e8df-4e13-b4a3-a694a4e6e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:45.049982 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8c542b7f-e8df-4e13-b4a3-a694a4e6e958 None None] MFA Rules not processed for user `ae7551e9626541d49a1be9330094f42e`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:45.051367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8c542b7f-e8df-4e13-b4a3-a694a4e6e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:45.058917 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1310/2598] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:30:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:45.072986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b901-97df-40dd-97fe-f8c70aa937a3 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:45.088560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b901-97df-40dd-97fe-f8c70aa937a3 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:45.096604 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78828acc-74f4-45fb-8633-18d32a371130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:45.097648 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78828acc-74f4-45fb-8633-18d32a371130 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:45.098036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78828acc-74f4-45fb-8633-18d32a371130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:45.098504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78828acc-74f4-45fb-8633-18d32a371130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:45.110841 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78828acc-74f4-45fb-8633-18d32a371130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:45.113347 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78828acc-74f4-45fb-8633-18d32a371130 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:45.125601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1289/2599] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:45.235011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491d125-7e67-4b91-b10f-4cd6a5a41703 None None] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:45.235661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491d125-7e67-4b91-b10f-4cd6a5a41703 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:45.235661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491d125-7e67-4b91-b10f-4cd6a5a41703 None None] PATH_INFO: `/` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:45.237060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1311/2600] 10.222.0.46 () {54 vars in 921 bytes} [Thu Jun 2 13:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:45.243696 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0263730-1bda-4af4-b1de-8f2560432115 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:45.244059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0263730-1bda-4af4-b1de-8f2560432115 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:45.244512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0263730-1bda-4af4-b1de-8f2560432115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:45.265969 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-e0263730-1bda-4af4-b1de-8f2560432115 None None] MFA Rules not processed for user `ae1c6084061f4434864e9f7bcc553733`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:45.268854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e0263730-1bda-4af4-b1de-8f2560432115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:45.281394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1290/2601] 10.222.0.46 () {58 vars in 1018 bytes} [Thu Jun 2 13:30:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:45.293793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491d125-7e67-4b91-b10f-4cd6a5a41703 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:45.296842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c491d125-7e67-4b91-b10f-4cd6a5a41703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:45.317442 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491d125-7e67-4b91-b10f-4cd6a5a41703 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:45.321910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828eb0-f5e9-4382-bf29-bbe2f6921163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:45.322801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828eb0-f5e9-4382-bf29-bbe2f6921163 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:45.323267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828eb0-f5e9-4382-bf29-bbe2f6921163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:45.323711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828eb0-f5e9-4382-bf29-bbe2f6921163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:45.337246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be828eb0-f5e9-4382-bf29-bbe2f6921163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:45.338743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be828eb0-f5e9-4382-bf29-bbe2f6921163 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:45.350745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1312/2602] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:45.425575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0263730-1bda-4af4-b1de-8f2560432115 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:45.425873 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e0263730-1bda-4af4-b1de-8f2560432115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:45.528774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0263730-1bda-4af4-b1de-8f2560432115 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:45.534058 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cffcb-8bca-43de-b231-43424fdbe867 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:45.534879 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cffcb-8bca-43de-b231-43424fdbe867 service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:45.535171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cffcb-8bca-43de-b231-43424fdbe867 service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:45.535482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cffcb-8bca-43de-b231-43424fdbe867 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:45.537304 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5e0cffcb-8bca-43de-b231-43424fdbe867 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:45.549484 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cffcb-8bca-43de-b231-43424fdbe867 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:45.551095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cffcb-8bca-43de-b231-43424fdbe867 service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:45.563105 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1291/2603] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:47.290793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828eb0-f5e9-4382-bf29-bbe2f6921163 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:47.301361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828eb0-f5e9-4382-bf29-bbe2f6921163 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:47.307448 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5cb7a-6529-4771-94bf-7d6b844b2f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:47.310836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5cb7a-6529-4771-94bf-7d6b844b2f3b service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:47.310836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5cb7a-6529-4771-94bf-7d6b844b2f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:47.310836 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5cb7a-6529-4771-94bf-7d6b844b2f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:47.313350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c0c5cb7a-6529-4771-94bf-7d6b844b2f3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:47.327238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5cb7a-6529-4771-94bf-7d6b844b2f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:47.330853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5cb7a-6529-4771-94bf-7d6b844b2f3b service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:47.340747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1313/2604] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:48.494394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68475d4-65be-464c-a87e-a15c0c23dc80 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:48.496073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68475d4-65be-464c-a87e-a15c0c23dc80 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:48.496576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68475d4-65be-464c-a87e-a15c0c23dc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:48.523156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c68475d4-65be-464c-a87e-a15c0c23dc80 None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:48.524554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c68475d4-65be-464c-a87e-a15c0c23dc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:48.539401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1292/2605] 10.222.0.46 () {58 vars in 1009 bytes} [Thu Jun 2 13:30:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:48.550141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5cb7a-6529-4771-94bf-7d6b844b2f3b service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:48.567013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5cb7a-6529-4771-94bf-7d6b844b2f3b service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:48.574739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fddfe-a55c-4cae-9112-904d096189e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:48.576012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fddfe-a55c-4cae-9112-904d096189e8 service swift] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:48.576515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fddfe-a55c-4cae-9112-904d096189e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:48.576969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fddfe-a55c-4cae-9112-904d096189e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:48.587612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fddfe-a55c-4cae-9112-904d096189e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:48.589684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fddfe-a55c-4cae-9112-904d096189e8 service swift] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:48.612150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1314/2606] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:30:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:30:58.514595 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=47 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:58.597865 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=47 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:08.672707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea7af0-1c9d-4ef7-af1d-a09a8507b07d None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:08.673240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea7af0-1c9d-4ef7-af1d-a09a8507b07d None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:08.673341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea7af0-1c9d-4ef7-af1d-a09a8507b07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:08.692205 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-1dea7af0-1c9d-4ef7-af1d-a09a8507b07d None None] MFA Rules not processed for user `4683d277112848ce9b49db3b15aaa32c`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:08.693429 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1dea7af0-1c9d-4ef7-af1d-a09a8507b07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:08.700681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1293/2607] 10.222.0.46 () {58 vars in 967 bytes} [Thu Jun 2 13:31:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:08.713652 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fddfe-a55c-4cae-9112-904d096189e8 service swift] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:08.724983 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fddfe-a55c-4cae-9112-904d096189e8 service swift] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:08.729912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb480abd-0270-4cbc-8de7-d2f35fe763c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4d690feb01473eaee368408c8a1dab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:08.730551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb480abd-0270-4cbc-8de7-d2f35fe763c4 service swift] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:08.730834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb480abd-0270-4cbc-8de7-d2f35fe763c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:08.732240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb480abd-0270-4cbc-8de7-d2f35fe763c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:08.741065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb480abd-0270-4cbc-8de7-d2f35fe763c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:08.742674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb480abd-0270-4cbc-8de7-d2f35fe763c4 service swift] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:08.751171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1315/2608] 10.222.0.46 () {60 vars in 1384 bytes} [Thu Jun 2 13:31:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:31:18.685782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:18.747659 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=6 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:21.655386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea7af0-1c9d-4ef7-af1d-a09a8507b07d None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:21.664854 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea7af0-1c9d-4ef7-af1d-a09a8507b07d None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:21.668450 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9aaf9-068e-48b5-a3c8-a45c7dae440e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:21.669683 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9aaf9-068e-48b5-a3c8-a45c7dae440e service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:21.669961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9aaf9-068e-48b5-a3c8-a45c7dae440e service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:21.670230 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9aaf9-068e-48b5-a3c8-a45c7dae440e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:21.672075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-36f9aaf9-068e-48b5-a3c8-a45c7dae440e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:21.738396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9aaf9-068e-48b5-a3c8-a45c7dae440e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:21.739951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9aaf9-068e-48b5-a3c8-a45c7dae440e service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:21.750716 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1294/2609] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:25.594884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb480abd-0270-4cbc-8de7-d2f35fe763c4 service swift] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:25.602438 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-eb480abd-0270-4cbc-8de7-d2f35fe763c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:25.618144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb480abd-0270-4cbc-8de7-d2f35fe763c4 service swift] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:25.623377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:25.624322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:25.627326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:25.627326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] PATH_INFO: `/v3/users/a99a2ba62f3948e99f6e78cabade3685` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:25.639557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99a2ba62f3948e99f6e78cabade3685)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:25.641660 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:25.920077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99a2ba62f3948e99f6e78cabade3685'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:25.974344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99a2ba62f3948e99f6e78cabade3685'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:25.987566 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99a2ba62f3948e99f6e78cabade3685'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:25.988273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99a2ba62f3948e99f6e78cabade3685'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:25.996050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5db5f478-d5be-4edd-913b-73ec5bcaddd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99a2ba62f3948e99f6e78cabade3685'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:26.002724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1316/2610] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:31:25 2022] DELETE /identity/v3/users/a99a2ba62f3948e99f6e78cabade3685 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:26.248792 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9aaf9-068e-48b5-a3c8-a45c7dae440e service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:26.259384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9aaf9-068e-48b5-a3c8-a45c7dae440e service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:26.317961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:26.318838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:26.319122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:26.319426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] PATH_INFO: `/v3/projects/907c2f17d46e4ebd974386bc7fae2fc9` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:26.331965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907c2f17d46e4ebd974386bc7fae2fc9)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:26.333978 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:26.461184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907c2f17d46e4ebd974386bc7fae2fc9', 'request_id': 'req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:26.468508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907c2f17d46e4ebd974386bc7fae2fc9', 'request_id': 'req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:26.550233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907c2f17d46e4ebd974386bc7fae2fc9', 'request_id': 'req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:26.562055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] The token cache is being invalidate because project 907c2f17d46e4ebd974386bc7fae2fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:31:26.562361 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:26.562999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-10982ea4-d793-4dcb-ae06-7ef5a0aa8138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:26.564584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1295/2611] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:31:26 2022] DELETE /identity/v3/projects/907c2f17d46e4ebd974386bc7fae2fc9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:26.570403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0867e-237a-49aa-a8d5-fd12bd9ad593 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:26.570724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0867e-237a-49aa-a8d5-fd12bd9ad593 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:26.571006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0867e-237a-49aa-a8d5-fd12bd9ad593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:26.590720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-17b0867e-237a-49aa-a8d5-fd12bd9ad593 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:26.591950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-17b0867e-237a-49aa-a8d5-fd12bd9ad593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:26.655417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1317/2612] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:26.663488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37496e-56ad-4e87-9160-ff48f33a3ad8 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:26.663808 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37496e-56ad-4e87-9160-ff48f33a3ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:26.664153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37496e-56ad-4e87-9160-ff48f33a3ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:26.682025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-6c37496e-56ad-4e87-9160-ff48f33a3ad8 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:26.683240 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6c37496e-56ad-4e87-9160-ff48f33a3ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:26.691811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1296/2613] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:26.696148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0867e-237a-49aa-a8d5-fd12bd9ad593 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:26.706641 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0867e-237a-49aa-a8d5-fd12bd9ad593 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:26.711619 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44134c-7571-4976-a7a2-cc70580e3c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:26.712321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44134c-7571-4976-a7a2-cc70580e3c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:26.712608 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44134c-7571-4976-a7a2-cc70580e3c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:26.712887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44134c-7571-4976-a7a2-cc70580e3c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:26.713649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44134c-7571-4976-a7a2-cc70580e3c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:26.713958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44134c-7571-4976-a7a2-cc70580e3c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:26.715636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44134c-7571-4976-a7a2-cc70580e3c30 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:26.727951 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1318/2614] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:26.732308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37496e-56ad-4e87-9160-ff48f33a3ad8 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:26.741710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37496e-56ad-4e87-9160-ff48f33a3ad8 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:26.747073 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83fb7-7fde-4bb8-9982-0e1828bcab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:26.747737 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83fb7-7fde-4bb8-9982-0e1828bcab5d admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:26.748062 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83fb7-7fde-4bb8-9982-0e1828bcab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:26.748342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83fb7-7fde-4bb8-9982-0e1828bcab5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:26.749049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d83fb7-7fde-4bb8-9982-0e1828bcab5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:26.750965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d83fb7-7fde-4bb8-9982-0e1828bcab5d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:26.755226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:26.879456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1297/2615] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:31:26 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:26.883680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44134c-7571-4976-a7a2-cc70580e3c30 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:26.894556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44134c-7571-4976-a7a2-cc70580e3c30 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:26.943974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:26.956467 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79627282-09a1-46cd-9d51-d6f404d72489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:26.957151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79627282-09a1-46cd-9d51-d6f404d72489 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:26.957432 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79627282-09a1-46cd-9d51-d6f404d72489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:26.957707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79627282-09a1-46cd-9d51-d6f404d72489 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:26.958408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79627282-09a1-46cd-9d51-d6f404d72489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:26.960788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79627282-09a1-46cd-9d51-d6f404d72489 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.099906 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1319/2616] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:31:26 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:27.103638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83fb7-7fde-4bb8-9982-0e1828bcab5d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.114835 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83fb7-7fde-4bb8-9982-0e1828bcab5d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.119472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959a01-7194-4978-8cde-5eb36b2cb7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.120176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959a01-7194-4978-8cde-5eb36b2cb7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.120458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959a01-7194-4978-8cde-5eb36b2cb7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.120730 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959a01-7194-4978-8cde-5eb36b2cb7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.121598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7959a01-7194-4978-8cde-5eb36b2cb7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.123181 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7959a01-7194-4978-8cde-5eb36b2cb7b4 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.134229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1298/2617] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:27.139191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79627282-09a1-46cd-9d51-d6f404d72489 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.153346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79627282-09a1-46cd-9d51-d6f404d72489 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.161557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c384a-27f2-47b8-8191-050d37b95776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.162449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c384a-27f2-47b8-8191-050d37b95776 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.162896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c384a-27f2-47b8-8191-050d37b95776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.163312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c384a-27f2-47b8-8191-050d37b95776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.164078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c384a-27f2-47b8-8191-050d37b95776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.165792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c384a-27f2-47b8-8191-050d37b95776 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.177694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1320/2618] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:27.181790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959a01-7194-4978-8cde-5eb36b2cb7b4 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.192818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7959a01-7194-4978-8cde-5eb36b2cb7b4 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.200709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735711d-2f04-41ab-9e64-cfac78c108b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.201557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735711d-2f04-41ab-9e64-cfac78c108b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.201842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735711d-2f04-41ab-9e64-cfac78c108b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.202122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735711d-2f04-41ab-9e64-cfac78c108b7 admin admin] PATH_INFO: `/v3/projects/8cd9b8deb72747a3a1822c24b4c43c76/users/9b83c2d1217a4e879d0938a3a7ca0d6b/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.220886 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735711d-2f04-41ab-9e64-cfac78c108b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd9b8deb72747a3a1822c24b4c43c76, user_id=9b83c2d1217a4e879d0938a3a7ca0d6b, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.223633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735711d-2f04-41ab-9e64-cfac78c108b7 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.311482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1299/2619] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:27 2022] PUT /identity/v3/projects/8cd9b8deb72747a3a1822c24b4c43c76/users/9b83c2d1217a4e879d0938a3a7ca0d6b/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:27.322978 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13417f-5333-4043-8b48-89cbfeba71a9 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.323357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13417f-5333-4043-8b48-89cbfeba71a9 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.323812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13417f-5333-4043-8b48-89cbfeba71a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.352952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4b13417f-5333-4043-8b48-89cbfeba71a9 None None] MFA Rules not processed for user `9b83c2d1217a4e879d0938a3a7ca0d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:27.354187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4b13417f-5333-4043-8b48-89cbfeba71a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:27.396960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735711d-2f04-41ab-9e64-cfac78c108b7 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.399336 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b735711d-2f04-41ab-9e64-cfac78c108b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:27.445208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1321/2620] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:27.450447 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13417f-5333-4043-8b48-89cbfeba71a9 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.487838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735711d-2f04-41ab-9e64-cfac78c108b7 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.491920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00c12-6899-46d8-9927-52d73e7ddc69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.493660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00c12-6899-46d8-9927-52d73e7ddc69 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.494174 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00c12-6899-46d8-9927-52d73e7ddc69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.494525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00c12-6899-46d8-9927-52d73e7ddc69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.497484 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-10b00c12-6899-46d8-9927-52d73e7ddc69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:27.509477 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b00c12-6899-46d8-9927-52d73e7ddc69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.511206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b00c12-6899-46d8-9927-52d73e7ddc69 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.522075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1300/2621] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:31:27.533070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13417f-5333-4043-8b48-89cbfeba71a9 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.537977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bc761-22b1-4475-a17c-dbee99eeb5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.542912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bc761-22b1-4475-a17c-dbee99eeb5ea admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.542912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bc761-22b1-4475-a17c-dbee99eeb5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.542912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bc761-22b1-4475-a17c-dbee99eeb5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.542912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bc761-22b1-4475-a17c-dbee99eeb5ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.542912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bc761-22b1-4475-a17c-dbee99eeb5ea admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.600748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00c12-6899-46d8-9927-52d73e7ddc69 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.609592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00c12-6899-46d8-9927-52d73e7ddc69 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.613346 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bda51c-c298-4007-8085-0329708fc2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.613997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bda51c-c298-4007-8085-0329708fc2ab service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.614287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bda51c-c298-4007-8085-0329708fc2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.614589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bda51c-c298-4007-8085-0329708fc2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.616439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-47bda51c-c298-4007-8085-0329708fc2ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:27.644590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1322/2622] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:31:27 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:31:27.648741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bc761-22b1-4475-a17c-dbee99eeb5ea admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.692786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bda51c-c298-4007-8085-0329708fc2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.694237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bda51c-c298-4007-8085-0329708fc2ab service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.694879 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:27.706108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1301/2623] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:31:27.718726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bc761-22b1-4475-a17c-dbee99eeb5ea admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.723508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07da5e6-11c5-4cd3-9bb7-d8c8a5f3099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.724216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07da5e6-11c5-4cd3-9bb7-d8c8a5f3099c admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.724504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07da5e6-11c5-4cd3-9bb7-d8c8a5f3099c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.724782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07da5e6-11c5-4cd3-9bb7-d8c8a5f3099c admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.725513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07da5e6-11c5-4cd3-9bb7-d8c8a5f3099c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.727493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07da5e6-11c5-4cd3-9bb7-d8c8a5f3099c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.832092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1323/2624] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:31:27 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:31:27.837276 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bda51c-c298-4007-8085-0329708fc2ab service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.847760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bda51c-c298-4007-8085-0329708fc2ab service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.852733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f7196-74b5-4a2d-a635-bab3280fa526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.853423 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f7196-74b5-4a2d-a635-bab3280fa526 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.854454 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f7196-74b5-4a2d-a635-bab3280fa526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.854733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f7196-74b5-4a2d-a635-bab3280fa526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.855358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f7196-74b5-4a2d-a635-bab3280fa526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.857571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f7196-74b5-4a2d-a635-bab3280fa526 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.869389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1302/2625] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:27.875302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07da5e6-11c5-4cd3-9bb7-d8c8a5f3099c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.887298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07da5e6-11c5-4cd3-9bb7-d8c8a5f3099c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.895076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e0f93-fac6-46a6-a6ef-25fc0408cb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.896126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e0f93-fac6-46a6-a6ef-25fc0408cb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.896416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e0f93-fac6-46a6-a6ef-25fc0408cb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.900388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e0f93-fac6-46a6-a6ef-25fc0408cb36 admin admin] PATH_INFO: `/v3/projects/fbaba29300664ef89c9cba5f45ec788c/users/0d38c7b35a364a0aa2f7b6a8371da164/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.914469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e0f93-fac6-46a6-a6ef-25fc0408cb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbaba29300664ef89c9cba5f45ec788c, user_id=0d38c7b35a364a0aa2f7b6a8371da164, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.917273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e0f93-fac6-46a6-a6ef-25fc0408cb36 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.937223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f7196-74b5-4a2d-a635-bab3280fa526 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.939002 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b75f7196-74b5-4a2d-a635-bab3280fa526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:27.974339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:27.987785 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1324/2626] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:27 2022] PUT /identity/v3/projects/fbaba29300664ef89c9cba5f45ec788c/users/0d38c7b35a364a0aa2f7b6a8371da164/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:27.991998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e0f93-fac6-46a6-a6ef-25fc0408cb36 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:28.021612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f7196-74b5-4a2d-a635-bab3280fa526 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:28.075231 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e0f93-fac6-46a6-a6ef-25fc0408cb36 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:28.083357 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25444893-f67f-4f56-aa08-e6c8c65797cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:28.084153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25444893-f67f-4f56-aa08-e6c8c65797cc admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.084511 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25444893-f67f-4f56-aa08-e6c8c65797cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.084861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25444893-f67f-4f56-aa08-e6c8c65797cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.086135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25444893-f67f-4f56-aa08-e6c8c65797cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:28.087848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25444893-f67f-4f56-aa08-e6c8c65797cc admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:28.100674 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1325/2627] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:31:28.104897 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25444893-f67f-4f56-aa08-e6c8c65797cc admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:28.108199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792a179-77cc-438f-9aac-2a92f37854ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:28.115079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792a179-77cc-438f-9aac-2a92f37854ee service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.115079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792a179-77cc-438f-9aac-2a92f37854ee service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.115079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792a179-77cc-438f-9aac-2a92f37854ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.115079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-8792a179-77cc-438f-9aac-2a92f37854ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:28.124525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792a179-77cc-438f-9aac-2a92f37854ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:28.126164 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792a179-77cc-438f-9aac-2a92f37854ee service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:28.129388 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25444893-f67f-4f56-aa08-e6c8c65797cc admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:28.134278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097535c1-07ce-4fb1-8846-2b2cbd46a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:28.135190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097535c1-07ce-4fb1-8846-2b2cbd46a606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.135473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097535c1-07ce-4fb1-8846-2b2cbd46a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.135752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097535c1-07ce-4fb1-8846-2b2cbd46a606 admin admin] PATH_INFO: `/v3/projects/fbaba29300664ef89c9cba5f45ec788c/users/0d38c7b35a364a0aa2f7b6a8371da164/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.137832 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1303/2628] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:31:28.138020 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097535c1-07ce-4fb1-8846-2b2cbd46a606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbaba29300664ef89c9cba5f45ec788c, user_id=0d38c7b35a364a0aa2f7b6a8371da164, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:28.140671 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097535c1-07ce-4fb1-8846-2b2cbd46a606 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:28.152123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1326/2629] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:28 2022] PUT /identity/v3/projects/fbaba29300664ef89c9cba5f45ec788c/users/0d38c7b35a364a0aa2f7b6a8371da164/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:28.164444 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d935a4-32cb-4a8c-94b8-1260626ea187 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.166576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d935a4-32cb-4a8c-94b8-1260626ea187 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.166576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d935a4-32cb-4a8c-94b8-1260626ea187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.192888 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-d3d935a4-32cb-4a8c-94b8-1260626ea187 None None] MFA Rules not processed for user `0d38c7b35a364a0aa2f7b6a8371da164`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:28.194118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d3d935a4-32cb-4a8c-94b8-1260626ea187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:28.271082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1304/2630] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:28.282502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097535c1-07ce-4fb1-8846-2b2cbd46a606 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:28.284249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-097535c1-07ce-4fb1-8846-2b2cbd46a606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:28.344234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097535c1-07ce-4fb1-8846-2b2cbd46a606 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:28.348680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90205a6e-5c4b-4b66-a41a-cba12a2ef435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:28.349346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90205a6e-5c4b-4b66-a41a-cba12a2ef435 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.349630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90205a6e-5c4b-4b66-a41a-cba12a2ef435 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.349908 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90205a6e-5c4b-4b66-a41a-cba12a2ef435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.362347 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90205a6e-5c4b-4b66-a41a-cba12a2ef435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:28.364106 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90205a6e-5c4b-4b66-a41a-cba12a2ef435 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:28.375122 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1327/2631] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:31:29.507163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d935a4-32cb-4a8c-94b8-1260626ea187 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:29.551037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=100 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:29.571492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d935a4-32cb-4a8c-94b8-1260626ea187 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:29.576050 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:29.576919 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:29.577206 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:29.577483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] PATH_INFO: `/v3/users/9b83c2d1217a4e879d0938a3a7ca0d6b` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:29.578695 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b83c2d1217a4e879d0938a3a7ca0d6b)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:29.580794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:29.727765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b83c2d1217a4e879d0938a3a7ca0d6b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:29.780143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b83c2d1217a4e879d0938a3a7ca0d6b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:29.793142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b83c2d1217a4e879d0938a3a7ca0d6b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:29.794396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b83c2d1217a4e879d0938a3a7ca0d6b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:29.802517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b83c2d1217a4e879d0938a3a7ca0d6b'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:29.809408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1305/2632] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:31:29 2022] DELETE /identity/v3/users/9b83c2d1217a4e879d0938a3a7ca0d6b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:29.813607 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388848ad-2b81-4082-a443-4bc97f27975e None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:29.814135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388848ad-2b81-4082-a443-4bc97f27975e None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:29.814237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388848ad-2b81-4082-a443-4bc97f27975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:29.832925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-388848ad-2b81-4082-a443-4bc97f27975e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:29.834097 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-388848ad-2b81-4082-a443-4bc97f27975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:29.867757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:29.900878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1328/2633] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:29.911769 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:29.913408 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:29.983227 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e194f-a992-4614-bf44-05a8f1ab1e1a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:29.987199 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dc84b-6df3-4773-97da-14a2415c0458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:29.987895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dc84b-6df3-4773-97da-14a2415c0458 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:29.988197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dc84b-6df3-4773-97da-14a2415c0458 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:29.988473 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dc84b-6df3-4773-97da-14a2415c0458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:29.999607 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dc84b-6df3-4773-97da-14a2415c0458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:30.001163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dc84b-6df3-4773-97da-14a2415c0458 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:30.012570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1306/2634] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:30.506578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388848ad-2b81-4082-a443-4bc97f27975e None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:30.508038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-388848ad-2b81-4082-a443-4bc97f27975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:30.532006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388848ad-2b81-4082-a443-4bc97f27975e None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:30.540005 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:30.541040 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:30.541417 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:30.541699 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] PATH_INFO: `/v3/projects/8cd9b8deb72747a3a1822c24b4c43c76` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:30.543061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd9b8deb72747a3a1822c24b4c43c76)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:30.545051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:30.644413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd9b8deb72747a3a1822c24b4c43c76', 'request_id': 'req-f7584dfb-3037-4965-843b-3e2bf7009750'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:30.651170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd9b8deb72747a3a1822c24b4c43c76', 'request_id': 'req-f7584dfb-3037-4965-843b-3e2bf7009750'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:30.722657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd9b8deb72747a3a1822c24b4c43c76', 'request_id': 'req-f7584dfb-3037-4965-843b-3e2bf7009750'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:30.734704 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] The token cache is being invalidate because project 8cd9b8deb72747a3a1822c24b4c43c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:31:30.735064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:30.735664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:30.737228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1329/2635] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:31:30 2022] DELETE /identity/v3/projects/8cd9b8deb72747a3a1822c24b4c43c76 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:30.741279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dc84b-6df3-4773-97da-14a2415c0458 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:30.751656 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dc84b-6df3-4773-97da-14a2415c0458 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:30.810896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:30.811803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:30.812104 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:30.812383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] PATH_INFO: `/v3/users/0d38c7b35a364a0aa2f7b6a8371da164` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:30.813584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d38c7b35a364a0aa2f7b6a8371da164)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:30.815495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:30.817122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:31.000570 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d38c7b35a364a0aa2f7b6a8371da164'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:31.042548 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d38c7b35a364a0aa2f7b6a8371da164'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:31.055569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d38c7b35a364a0aa2f7b6a8371da164'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:31.061431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d38c7b35a364a0aa2f7b6a8371da164'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:31.063654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-a48ef3f8-8a8d-4126-bb7b-5fc68f07dfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d38c7b35a364a0aa2f7b6a8371da164'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:31.069631 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1307/2636] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:31:30 2022] DELETE /identity/v3/users/0d38c7b35a364a0aa2f7b6a8371da164 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:31.541694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:31.543528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:31.556741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7584dfb-3037-4965-843b-3e2bf7009750 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:31.614821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:31.615690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:31.616007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:31.616285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] PATH_INFO: `/v3/projects/fbaba29300664ef89c9cba5f45ec788c` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:31.617527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbaba29300664ef89c9cba5f45ec788c)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:31.622646 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:31.731988 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbaba29300664ef89c9cba5f45ec788c', 'request_id': 'req-809924e0-9902-4f90-879f-fbdfbf9494df'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:31.738268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbaba29300664ef89c9cba5f45ec788c', 'request_id': 'req-809924e0-9902-4f90-879f-fbdfbf9494df'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:31.741981 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:31.814808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbaba29300664ef89c9cba5f45ec788c', 'request_id': 'req-809924e0-9902-4f90-879f-fbdfbf9494df'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:31.826885 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] The token cache is being invalidate because project fbaba29300664ef89c9cba5f45ec788c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:31:31.827169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:31.827842 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-809924e0-9902-4f90-879f-fbdfbf9494df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:31.829419 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1330/2637] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:31:31 2022] DELETE /identity/v3/projects/fbaba29300664ef89c9cba5f45ec788c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:31.834315 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664acd0-aa93-49eb-8cef-e776a60598fa None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:31.834804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664acd0-aa93-49eb-8cef-e776a60598fa None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:31.835165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664acd0-aa93-49eb-8cef-e776a60598fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:31.852645 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-4664acd0-aa93-49eb-8cef-e776a60598fa None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:31.853858 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4664acd0-aa93-49eb-8cef-e776a60598fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:31.917268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1308/2638] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:31.925207 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4957ab-693d-4c97-8859-02be9addaa7d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:31.925499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4957ab-693d-4c97-8859-02be9addaa7d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:31.925778 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4957ab-693d-4c97-8859-02be9addaa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:31.945701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3f4957ab-693d-4c97-8859-02be9addaa7d None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:31.946931 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3f4957ab-693d-4c97-8859-02be9addaa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:31.955769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1331/2639] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:31.960328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664acd0-aa93-49eb-8cef-e776a60598fa None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:31.970162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664acd0-aa93-49eb-8cef-e776a60598fa None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:31.974847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa090b4-4b09-4a13-866f-77c75487fb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:31.975513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa090b4-4b09-4a13-866f-77c75487fb5e admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:31.975807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa090b4-4b09-4a13-866f-77c75487fb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:31.976142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa090b4-4b09-4a13-866f-77c75487fb5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:31.976874 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa090b4-4b09-4a13-866f-77c75487fb5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:31.977185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa090b4-4b09-4a13-866f-77c75487fb5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:31.978790 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa090b4-4b09-4a13-866f-77c75487fb5e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:31.990524 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1309/2640] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:31.995123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4957ab-693d-4c97-8859-02be9addaa7d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:32.005498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4957ab-693d-4c97-8859-02be9addaa7d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:32.010695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197c83e-f517-4df4-bc79-620ef7d3ac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:32.011582 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c83e-f517-4df4-bc79-620ef7d3ac25 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.012032 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c83e-f517-4df4-bc79-620ef7d3ac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.018314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197c83e-f517-4df4-bc79-620ef7d3ac25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.018314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197c83e-f517-4df4-bc79-620ef7d3ac25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:32.018314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197c83e-f517-4df4-bc79-620ef7d3ac25 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:32.113727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1332/2641] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:31:31 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:32.117941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa090b4-4b09-4a13-866f-77c75487fb5e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:32.127964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa090b4-4b09-4a13-866f-77c75487fb5e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:32.186638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd219-7e6a-42d5-bf8a-b487d0116545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:32.187316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd219-7e6a-42d5-bf8a-b487d0116545 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.187601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd219-7e6a-42d5-bf8a-b487d0116545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.187908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd219-7e6a-42d5-bf8a-b487d0116545 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.188601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cd219-7e6a-42d5-bf8a-b487d0116545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:32.190518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cd219-7e6a-42d5-bf8a-b487d0116545 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:32.200646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:32.300894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1310/2642] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:31:32 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:32.304901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197c83e-f517-4df4-bc79-620ef7d3ac25 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:32.316208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197c83e-f517-4df4-bc79-620ef7d3ac25 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:32.321070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5169f3-2d70-4bdc-87fc-0548abfda218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:32.321838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5169f3-2d70-4bdc-87fc-0548abfda218 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.322126 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5169f3-2d70-4bdc-87fc-0548abfda218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.322402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5169f3-2d70-4bdc-87fc-0548abfda218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.323137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5169f3-2d70-4bdc-87fc-0548abfda218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:32.325286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5169f3-2d70-4bdc-87fc-0548abfda218 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:32.338901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1333/2643] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:32.342306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd219-7e6a-42d5-bf8a-b487d0116545 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:32.352308 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd219-7e6a-42d5-bf8a-b487d0116545 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:32.357433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666452e-8afa-4c1f-be29-9cf744c7747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:32.358574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666452e-8afa-4c1f-be29-9cf744c7747e admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.358941 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666452e-8afa-4c1f-be29-9cf744c7747e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.359222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666452e-8afa-4c1f-be29-9cf744c7747e admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.359993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666452e-8afa-4c1f-be29-9cf744c7747e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:32.361592 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666452e-8afa-4c1f-be29-9cf744c7747e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:32.372576 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1311/2644] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:32.376733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5169f3-2d70-4bdc-87fc-0548abfda218 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:32.388013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5169f3-2d70-4bdc-87fc-0548abfda218 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:32.395545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb876-bff2-4065-a64c-aa617d72e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:32.395545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb876-bff2-4065-a64c-aa617d72e943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.395545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb876-bff2-4065-a64c-aa617d72e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.395545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb876-bff2-4065-a64c-aa617d72e943 admin admin] PATH_INFO: `/v3/projects/09c4c47cfad64b03bb05b19be769a0ef/users/9364e93b79bf4e97a9a8614675a75216/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.411376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcb876-bff2-4065-a64c-aa617d72e943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c4c47cfad64b03bb05b19be769a0ef, user_id=9364e93b79bf4e97a9a8614675a75216, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:32.414120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcb876-bff2-4065-a64c-aa617d72e943 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:32.488973 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1334/2645] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:32 2022] PUT /identity/v3/projects/09c4c47cfad64b03bb05b19be769a0ef/users/9364e93b79bf4e97a9a8614675a75216/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:32.500130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545b700-a49a-42f0-ad7e-0a6cca923f14 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.500470 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545b700-a49a-42f0-ad7e-0a6cca923f14 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.500755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545b700-a49a-42f0-ad7e-0a6cca923f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.527249 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-8545b700-a49a-42f0-ad7e-0a6cca923f14 None None] MFA Rules not processed for user `9364e93b79bf4e97a9a8614675a75216`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:32.528525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-8545b700-a49a-42f0-ad7e-0a6cca923f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:32.593384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1312/2646] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:32.597911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb876-bff2-4065-a64c-aa617d72e943 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:32.658663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb876-bff2-4065-a64c-aa617d72e943 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:32.663327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435a0dc-3601-438a-91a4-771e1c3c82e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:32.664027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a0dc-3601-438a-91a4-771e1c3c82e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.664313 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a0dc-3601-438a-91a4-771e1c3c82e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.664587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a0dc-3601-438a-91a4-771e1c3c82e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.665279 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435a0dc-3601-438a-91a4-771e1c3c82e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:32.667169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435a0dc-3601-438a-91a4-771e1c3c82e7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:32.764370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1335/2647] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:31:32 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:32.768523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545b700-a49a-42f0-ad7e-0a6cca923f14 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:32.780017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545b700-a49a-42f0-ad7e-0a6cca923f14 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:32.835678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb459a-e4e3-44b5-95c1-75780f5dcfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:32.836377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb459a-e4e3-44b5-95c1-75780f5dcfba admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.836647 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb459a-e4e3-44b5-95c1-75780f5dcfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.836918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb459a-e4e3-44b5-95c1-75780f5dcfba admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.837643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb459a-e4e3-44b5-95c1-75780f5dcfba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:32.839646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb459a-e4e3-44b5-95c1-75780f5dcfba admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:32.917624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1313/2648] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:31:32 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:32.922064 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435a0dc-3601-438a-91a4-771e1c3c82e7 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:32.932635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435a0dc-3601-438a-91a4-771e1c3c82e7 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:32.937283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c78ac-4708-425c-891f-c03755604df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:32.941187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c78ac-4708-425c-891f-c03755604df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.941187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c78ac-4708-425c-891f-c03755604df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.941187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c78ac-4708-425c-891f-c03755604df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.941187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c78ac-4708-425c-891f-c03755604df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:32.941187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c78ac-4708-425c-891f-c03755604df4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:32.951996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1336/2649] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:32.956209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb459a-e4e3-44b5-95c1-75780f5dcfba admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:32.967520 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb459a-e4e3-44b5-95c1-75780f5dcfba admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:32.972263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a2f13-b868-42d5-89ca-321916f46b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:32.973151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a2f13-b868-42d5-89ca-321916f46b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:32.973434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a2f13-b868-42d5-89ca-321916f46b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:32.973710 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a2f13-b868-42d5-89ca-321916f46b6a admin admin] PATH_INFO: `/v3/projects/27bd74faeeef4e568c8d8f734a95644d/users/c7879a3cecca49b993fb1c7b05fe04b3/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:32.989876 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a2f13-b868-42d5-89ca-321916f46b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27bd74faeeef4e568c8d8f734a95644d, user_id=c7879a3cecca49b993fb1c7b05fe04b3, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:32.992568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a2f13-b868-42d5-89ca-321916f46b6a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:33.089370 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1314/2650] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:32 2022] PUT /identity/v3/projects/27bd74faeeef4e568c8d8f734a95644d/users/c7879a3cecca49b993fb1c7b05fe04b3/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:33.093894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c78ac-4708-425c-891f-c03755604df4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:33.104113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c78ac-4708-425c-891f-c03755604df4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:33.160476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:33.166442 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e41a42-5db8-456f-b297-bcd6d8b21e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:33.167148 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41a42-5db8-456f-b297-bcd6d8b21e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:33.167426 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41a42-5db8-456f-b297-bcd6d8b21e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:33.167753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41a42-5db8-456f-b297-bcd6d8b21e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:33.168589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e41a42-5db8-456f-b297-bcd6d8b21e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:33.170184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e41a42-5db8-456f-b297-bcd6d8b21e3b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:33.182601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1337/2651] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:33.184804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a2f13-b868-42d5-89ca-321916f46b6a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:33.195908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a2f13-b868-42d5-89ca-321916f46b6a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:33.202055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3d57e-aa1e-46c3-a810-aed5808b415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:33.202966 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3d57e-aa1e-46c3-a810-aed5808b415d admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:33.203260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3d57e-aa1e-46c3-a810-aed5808b415d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:33.203540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3d57e-aa1e-46c3-a810-aed5808b415d admin admin] PATH_INFO: `/v3/projects/27bd74faeeef4e568c8d8f734a95644d/users/c7879a3cecca49b993fb1c7b05fe04b3/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:33.205571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3d57e-aa1e-46c3-a810-aed5808b415d admin admin] RBAC: Authorizing `identity:create_grant(project_id=27bd74faeeef4e568c8d8f734a95644d, user_id=c7879a3cecca49b993fb1c7b05fe04b3, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:33.210282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3d57e-aa1e-46c3-a810-aed5808b415d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:33.220556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1315/2652] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:33 2022] PUT /identity/v3/projects/27bd74faeeef4e568c8d8f734a95644d/users/c7879a3cecca49b993fb1c7b05fe04b3/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:31:33.232177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228af96-f1be-4c67-8230-c9d7810b319a None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:33.233069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228af96-f1be-4c67-8230-c9d7810b319a None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:33.233845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228af96-f1be-4c67-8230-c9d7810b319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:33.263779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-5228af96-f1be-4c67-8230-c9d7810b319a None None] MFA Rules not processed for user `c7879a3cecca49b993fb1c7b05fe04b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:33.265038 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-5228af96-f1be-4c67-8230-c9d7810b319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:33.357726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1338/2653] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:31:33.370698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3d57e-aa1e-46c3-a810-aed5808b415d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:33.372449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4de3d57e-aa1e-46c3-a810-aed5808b415d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:33.404000 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:33.433327 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3d57e-aa1e-46c3-a810-aed5808b415d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:33.436988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2650383-27fe-4bcf-bc3e-27fa4ded85c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:33.437671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2650383-27fe-4bcf-bc3e-27fa4ded85c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:33.437949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2650383-27fe-4bcf-bc3e-27fa4ded85c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:33.438224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2650383-27fe-4bcf-bc3e-27fa4ded85c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:33.447427 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2650383-27fe-4bcf-bc3e-27fa4ded85c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:33.448889 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2650383-27fe-4bcf-bc3e-27fa4ded85c2 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:33.458200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1316/2654] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:33.902758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228af96-f1be-4c67-8230-c9d7810b319a None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:33.965728 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228af96-f1be-4c67-8230-c9d7810b319a None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:33.970132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:33.971011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:33.971294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:33.971573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] PATH_INFO: `/v3/users/9364e93b79bf4e97a9a8614675a75216` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:33.972800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9364e93b79bf4e97a9a8614675a75216)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:33.974851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:34.222864 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9364e93b79bf4e97a9a8614675a75216'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:34.402571 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9364e93b79bf4e97a9a8614675a75216'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:34.415761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9364e93b79bf4e97a9a8614675a75216'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:34.416499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9364e93b79bf4e97a9a8614675a75216'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:34.424288 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9364e93b79bf4e97a9a8614675a75216'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:34.427600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:34.433635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1339/2655] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:31:33 2022] DELETE /identity/v3/users/9364e93b79bf4e97a9a8614675a75216 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:34.439937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0dbf-165e-494f-a631-d624123bd4d7 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:34.439937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0dbf-165e-494f-a631-d624123bd4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:34.439937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0dbf-165e-494f-a631-d624123bd4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:34.460672 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-4cbc0dbf-165e-494f-a631-d624123bd4d7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:34.462154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4cbc0dbf-165e-494f-a631-d624123bd4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:34.540437 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1317/2656] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:34.549779 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:34.551196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:34.608123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4661c0-45ba-4696-81b9-be49251f0f83 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:34.611788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b1ae0-1822-4f6e-886d-bfe6039c4221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:34.612496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b1ae0-1822-4f6e-886d-bfe6039c4221 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:34.612782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b1ae0-1822-4f6e-886d-bfe6039c4221 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:34.613055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b1ae0-1822-4f6e-886d-bfe6039c4221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:34.623672 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b1ae0-1822-4f6e-886d-bfe6039c4221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:34.625299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b1ae0-1822-4f6e-886d-bfe6039c4221 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:34.634839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1340/2657] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:35.067595 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0dbf-165e-494f-a631-d624123bd4d7 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:35.069104 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4cbc0dbf-165e-494f-a631-d624123bd4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:35.089789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0dbf-165e-494f-a631-d624123bd4d7 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:35.089789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:35.089789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.089789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.090887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] PATH_INFO: `/v3/projects/09c4c47cfad64b03bb05b19be769a0ef` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.090887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c4c47cfad64b03bb05b19be769a0ef)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:35.091964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:35.209279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c4c47cfad64b03bb05b19be769a0ef', 'request_id': 'req-17872d9a-7163-451d-86e1-ecfc424d680f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:35.218409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c4c47cfad64b03bb05b19be769a0ef', 'request_id': 'req-17872d9a-7163-451d-86e1-ecfc424d680f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:35.282739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c4c47cfad64b03bb05b19be769a0ef', 'request_id': 'req-17872d9a-7163-451d-86e1-ecfc424d680f'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:35.293557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] The token cache is being invalidate because project 09c4c47cfad64b03bb05b19be769a0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:31:35.293843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:35.294476 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:35.296043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1318/2658] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:31:35 2022] DELETE /identity/v3/projects/09c4c47cfad64b03bb05b19be769a0ef => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:35.300131 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b1ae0-1822-4f6e-886d-bfe6039c4221 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:35.309863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b1ae0-1822-4f6e-886d-bfe6039c4221 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:35.366167 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:35.366973 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.367261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.367541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] PATH_INFO: `/v3/users/c7879a3cecca49b993fb1c7b05fe04b3` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.368873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7879a3cecca49b993fb1c7b05fe04b3)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:35.370809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:35.583069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7879a3cecca49b993fb1c7b05fe04b3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:35.682858 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7879a3cecca49b993fb1c7b05fe04b3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:35.696804 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7879a3cecca49b993fb1c7b05fe04b3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:35.697553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7879a3cecca49b993fb1c7b05fe04b3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:35.704654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a27d6490-bb51-4528-b12b-7c0779325872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7879a3cecca49b993fb1c7b05fe04b3'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:35.711087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1341/2659] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:31:35 2022] DELETE /identity/v3/users/c7879a3cecca49b993fb1c7b05fe04b3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:36.101294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.102743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:36.117866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17872d9a-7163-451d-86e1-ecfc424d680f admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.167542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:36.176236 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.179351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.179351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.179351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] PATH_INFO: `/v3/projects/27bd74faeeef4e568c8d8f734a95644d` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.179351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27bd74faeeef4e568c8d8f734a95644d)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.180714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.282700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27bd74faeeef4e568c8d8f734a95644d', 'request_id': 'req-0d00d01b-aeca-46b6-aa72-b953e0bb411a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:36.288773 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27bd74faeeef4e568c8d8f734a95644d', 'request_id': 'req-0d00d01b-aeca-46b6-aa72-b953e0bb411a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:36.357515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27bd74faeeef4e568c8d8f734a95644d', 'request_id': 'req-0d00d01b-aeca-46b6-aa72-b953e0bb411a'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:36.368387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] The token cache is being invalidate because project 27bd74faeeef4e568c8d8f734a95644d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:31:36.373425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:36.373425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-0d00d01b-aeca-46b6-aa72-b953e0bb411a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:36.373425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1319/2660] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:31:36 2022] DELETE /identity/v3/projects/27bd74faeeef4e568c8d8f734a95644d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:36.375667 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2374d-afe8-4e96-951a-8db87b0dcc19 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.376195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2374d-afe8-4e96-951a-8db87b0dcc19 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.376297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2374d-afe8-4e96-951a-8db87b0dcc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.394756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8bd2374d-afe8-4e96-951a-8db87b0dcc19 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:36.396088 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8bd2374d-afe8-4e96-951a-8db87b0dcc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:36.410182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:36.456052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1342/2661] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:36.464072 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c890bf-d167-4a79-b619-48deeac56057 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.464367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c890bf-d167-4a79-b619-48deeac56057 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.464653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c890bf-d167-4a79-b619-48deeac56057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.484672 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-41c890bf-d167-4a79-b619-48deeac56057 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:36.485869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-41c890bf-d167-4a79-b619-48deeac56057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:36.493788 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1320/2662] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:36.498015 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2374d-afe8-4e96-951a-8db87b0dcc19 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.508556 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2374d-afe8-4e96-951a-8db87b0dcc19 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.513172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f190b-4df8-4640-88ab-891b5dd54ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.513904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f190b-4df8-4640-88ab-891b5dd54ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.514184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f190b-4df8-4640-88ab-891b5dd54ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.514461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f190b-4df8-4640-88ab-891b5dd54ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.515189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f190b-4df8-4640-88ab-891b5dd54ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:36.515496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f190b-4df8-4640-88ab-891b5dd54ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.517215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f190b-4df8-4640-88ab-891b5dd54ec8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.529346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1343/2663] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:36.533659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c890bf-d167-4a79-b619-48deeac56057 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.542990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c890bf-d167-4a79-b619-48deeac56057 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.548270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559791c-7eae-4a00-9a55-1eb161e71db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.548942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559791c-7eae-4a00-9a55-1eb161e71db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.549231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559791c-7eae-4a00-9a55-1eb161e71db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.549512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559791c-7eae-4a00-9a55-1eb161e71db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.550204 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559791c-7eae-4a00-9a55-1eb161e71db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.552222 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559791c-7eae-4a00-9a55-1eb161e71db6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.644510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1321/2664] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:31:36 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:36.648822 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f190b-4df8-4640-88ab-891b5dd54ec8 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.659478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f190b-4df8-4640-88ab-891b5dd54ec8 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.715947 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c1e99-a32a-45d6-a09f-f5b64825f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.716547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c1e99-a32a-45d6-a09f-f5b64825f591 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.716832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c1e99-a32a-45d6-a09f-f5b64825f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.717104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c1e99-a32a-45d6-a09f-f5b64825f591 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.717797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c1e99-a32a-45d6-a09f-f5b64825f591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.719757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c1e99-a32a-45d6-a09f-f5b64825f591 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.837749 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1344/2665] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:31:36 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:36.842394 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559791c-7eae-4a00-9a55-1eb161e71db6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.852800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559791c-7eae-4a00-9a55-1eb161e71db6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.857531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d95241-8426-40de-ad76-c2d8d3bbc14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.858205 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d95241-8426-40de-ad76-c2d8d3bbc14b admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.858495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d95241-8426-40de-ad76-c2d8d3bbc14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.858778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d95241-8426-40de-ad76-c2d8d3bbc14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.860203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d95241-8426-40de-ad76-c2d8d3bbc14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.861150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d95241-8426-40de-ad76-c2d8d3bbc14b admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.872653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1322/2666] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:36.876721 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c1e99-a32a-45d6-a09f-f5b64825f591 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.886679 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c1e99-a32a-45d6-a09f-f5b64825f591 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.891709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f7507-2d05-4334-be22-a34212d86f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.892509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f7507-2d05-4334-be22-a34212d86f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.892792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f7507-2d05-4334-be22-a34212d86f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.893068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f7507-2d05-4334-be22-a34212d86f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.893788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f7507-2d05-4334-be22-a34212d86f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.895383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f7507-2d05-4334-be22-a34212d86f1b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.906163 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1345/2667] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:36.910458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d95241-8426-40de-ad76-c2d8d3bbc14b admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.920689 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d95241-8426-40de-ad76-c2d8d3bbc14b admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.925365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ab458-5d88-42cf-a6df-f96173dc6685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.926247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ab458-5d88-42cf-a6df-f96173dc6685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.926530 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ab458-5d88-42cf-a6df-f96173dc6685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.926806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ab458-5d88-42cf-a6df-f96173dc6685 admin admin] PATH_INFO: `/v3/projects/d853c26252a44bd5941566fc2e0a3e97/users/eef676255b35409cbda05c56898f80b4/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.941127 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ab458-5d88-42cf-a6df-f96173dc6685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d853c26252a44bd5941566fc2e0a3e97, user_id=eef676255b35409cbda05c56898f80b4, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.943768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ab458-5d88-42cf-a6df-f96173dc6685 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:37.025591 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1323/2668] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:36 2022] PUT /identity/v3/projects/d853c26252a44bd5941566fc2e0a3e97/users/eef676255b35409cbda05c56898f80b4/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:37.036147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3ef83-f503-4b77-b3ad-cec46a919639 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:37.036440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3ef83-f503-4b77-b3ad-cec46a919639 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:37.036717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3ef83-f503-4b77-b3ad-cec46a919639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:37.062861 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f2f3ef83-f503-4b77-b3ad-cec46a919639 None None] MFA Rules not processed for user `eef676255b35409cbda05c56898f80b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:37.064084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f2f3ef83-f503-4b77-b3ad-cec46a919639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:37.126425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1346/2669] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:37.137414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ab458-5d88-42cf-a6df-f96173dc6685 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:37.139101 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d32ab458-5d88-42cf-a6df-f96173dc6685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:37.195204 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ab458-5d88-42cf-a6df-f96173dc6685 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:37.198958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462e1f5-5324-4fd2-bd50-37ae00141941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:37.200170 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462e1f5-5324-4fd2-bd50-37ae00141941 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:37.200456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462e1f5-5324-4fd2-bd50-37ae00141941 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:37.200733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462e1f5-5324-4fd2-bd50-37ae00141941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:37.209025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462e1f5-5324-4fd2-bd50-37ae00141941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:37.210707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462e1f5-5324-4fd2-bd50-37ae00141941 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:37.219930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1324/2670] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:37.239478 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3ef83-f503-4b77-b3ad-cec46a919639 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:37.257158 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:37.302599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3ef83-f503-4b77-b3ad-cec46a919639 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:37.307774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:37.308708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:37.308994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:37.309271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] PATH_INFO: `/v3/users/eef676255b35409cbda05c56898f80b4` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:37.310485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef676255b35409cbda05c56898f80b4)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:37.312459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:37.512952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef676255b35409cbda05c56898f80b4'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:37.595142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef676255b35409cbda05c56898f80b4'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:37.607744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef676255b35409cbda05c56898f80b4'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:37.608425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef676255b35409cbda05c56898f80b4'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:37.615155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef676255b35409cbda05c56898f80b4'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:37.621328 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1347/2671] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:31:37 2022] DELETE /identity/v3/users/eef676255b35409cbda05c56898f80b4 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:37.625948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7114e63-caf2-446a-84ea-775da3f6a06e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:37.636252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7114e63-caf2-446a-84ea-775da3f6a06e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:37.636252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7114e63-caf2-446a-84ea-775da3f6a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:37.644017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-c7114e63-caf2-446a-84ea-775da3f6a06e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:37.645224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c7114e63-caf2-446a-84ea-775da3f6a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:37.662231 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:37.703300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1325/2672] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:37.713708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:37.715723 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:37.772113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7277f00-252c-4446-979e-77293fcbacb4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:37.775648 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd1a0e-f28e-4953-bfbc-ff9180bf8cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:37.776323 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1a0e-f28e-4953-bfbc-ff9180bf8cfc service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:37.776604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1a0e-f28e-4953-bfbc-ff9180bf8cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:37.776876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1a0e-f28e-4953-bfbc-ff9180bf8cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:37.786036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd1a0e-f28e-4953-bfbc-ff9180bf8cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:37.787461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd1a0e-f28e-4953-bfbc-ff9180bf8cfc service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:37.797490 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1348/2673] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:38.517472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7114e63-caf2-446a-84ea-775da3f6a06e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:38.519364 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c7114e63-caf2-446a-84ea-775da3f6a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:38.532089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7114e63-caf2-446a-84ea-775da3f6a06e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:38.536756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:38.537625 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.538031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.538309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] PATH_INFO: `/v3/projects/d853c26252a44bd5941566fc2e0a3e97` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.539526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d853c26252a44bd5941566fc2e0a3e97)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:38.541497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:38.642525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd853c26252a44bd5941566fc2e0a3e97', 'request_id': 'req-bf1d4980-e052-4696-9704-ce225dc15d92'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:38.648742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd853c26252a44bd5941566fc2e0a3e97', 'request_id': 'req-bf1d4980-e052-4696-9704-ce225dc15d92'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:38.716869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd853c26252a44bd5941566fc2e0a3e97', 'request_id': 'req-bf1d4980-e052-4696-9704-ce225dc15d92'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:38.727560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] The token cache is being invalidate because project d853c26252a44bd5941566fc2e0a3e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:31:38.727846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:38.728483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bf1d4980-e052-4696-9704-ce225dc15d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:38.730023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1326/2674] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:31:38 2022] DELETE /identity/v3/projects/d853c26252a44bd5941566fc2e0a3e97 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:38.735602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3614d-9696-4090-b30b-1aa4108989ad None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.736105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3614d-9696-4090-b30b-1aa4108989ad None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.736202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3614d-9696-4090-b30b-1aa4108989ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.753663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-03a3614d-9696-4090-b30b-1aa4108989ad None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:38.754867 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-03a3614d-9696-4090-b30b-1aa4108989ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:38.787076 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:38.812708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1349/2675] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:38.821092 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426499-84b9-4671-b7f7-e32ce00abf2e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.821382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426499-84b9-4671-b7f7-e32ce00abf2e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.821659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426499-84b9-4671-b7f7-e32ce00abf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.840509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b7426499-84b9-4671-b7f7-e32ce00abf2e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:38.841720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b7426499-84b9-4671-b7f7-e32ce00abf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:38.849675 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1327/2676] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:38.854246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3614d-9696-4090-b30b-1aa4108989ad None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:38.864392 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3614d-9696-4090-b30b-1aa4108989ad None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:38.868989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dcca2-d4ee-4749-a232-6a7d899ed885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:38.869653 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dcca2-d4ee-4749-a232-6a7d899ed885 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.870157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dcca2-d4ee-4749-a232-6a7d899ed885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.871026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dcca2-d4ee-4749-a232-6a7d899ed885 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.871797 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dcca2-d4ee-4749-a232-6a7d899ed885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:38.872136 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dcca2-d4ee-4749-a232-6a7d899ed885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:38.873824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dcca2-d4ee-4749-a232-6a7d899ed885 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:38.885698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1350/2677] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:38.890368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426499-84b9-4671-b7f7-e32ce00abf2e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:38.899613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426499-84b9-4671-b7f7-e32ce00abf2e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:38.904727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755a9d6-18a3-41a3-9e72-b4f5f81a0e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:38.905377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755a9d6-18a3-41a3-9e72-b4f5f81a0e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.905786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755a9d6-18a3-41a3-9e72-b4f5f81a0e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.906066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755a9d6-18a3-41a3-9e72-b4f5f81a0e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.906742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755a9d6-18a3-41a3-9e72-b4f5f81a0e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:38.908671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755a9d6-18a3-41a3-9e72-b4f5f81a0e60 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.027154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1328/2678] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:31:38 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:39.032377 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dcca2-d4ee-4749-a232-6a7d899ed885 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.042415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dcca2-d4ee-4749-a232-6a7d899ed885 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.098781 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde29ee-4bd7-410a-84da-3f4efccbca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.099453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde29ee-4bd7-410a-84da-3f4efccbca4e admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.099738 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde29ee-4bd7-410a-84da-3f4efccbca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.100051 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde29ee-4bd7-410a-84da-3f4efccbca4e admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.100741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde29ee-4bd7-410a-84da-3f4efccbca4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.102668 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde29ee-4bd7-410a-84da-3f4efccbca4e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.186280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1351/2679] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:31:39 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:39.190363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755a9d6-18a3-41a3-9e72-b4f5f81a0e60 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.200955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755a9d6-18a3-41a3-9e72-b4f5f81a0e60 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.205698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49f864-9b81-4d72-b9bd-0135f9109677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.206363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49f864-9b81-4d72-b9bd-0135f9109677 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.206652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49f864-9b81-4d72-b9bd-0135f9109677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.206940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49f864-9b81-4d72-b9bd-0135f9109677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.207666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49f864-9b81-4d72-b9bd-0135f9109677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.209306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49f864-9b81-4d72-b9bd-0135f9109677 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.219927 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1329/2680] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:39.224033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde29ee-4bd7-410a-84da-3f4efccbca4e admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.234539 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde29ee-4bd7-410a-84da-3f4efccbca4e admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.239280 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d29818-6327-4a58-9e0c-f11984dff036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.239965 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d29818-6327-4a58-9e0c-f11984dff036 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.240246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d29818-6327-4a58-9e0c-f11984dff036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.240521 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d29818-6327-4a58-9e0c-f11984dff036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.241331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d29818-6327-4a58-9e0c-f11984dff036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.242920 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d29818-6327-4a58-9e0c-f11984dff036 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.253289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1352/2681] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:39.257425 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49f864-9b81-4d72-b9bd-0135f9109677 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.267488 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49f864-9b81-4d72-b9bd-0135f9109677 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.272197 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7843f-97ee-465e-aabb-4d268e17c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.273085 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7843f-97ee-465e-aabb-4d268e17c5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.273373 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7843f-97ee-465e-aabb-4d268e17c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.273655 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7843f-97ee-465e-aabb-4d268e17c5f5 admin admin] PATH_INFO: `/v3/projects/a7e833cd197d4b1dbae731f391ef2667/users/57367d57bc3a4258993aba820461fa80/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.288016 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7843f-97ee-465e-aabb-4d268e17c5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e833cd197d4b1dbae731f391ef2667, user_id=57367d57bc3a4258993aba820461fa80, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.290699 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7843f-97ee-465e-aabb-4d268e17c5f5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.414356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1330/2682] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:39 2022] PUT /identity/v3/projects/a7e833cd197d4b1dbae731f391ef2667/users/57367d57bc3a4258993aba820461fa80/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:39.425253 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa322f5-42ec-455e-a351-9801803dbef4 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.425545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa322f5-42ec-455e-a351-9801803dbef4 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.425825 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa322f5-42ec-455e-a351-9801803dbef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.453684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3fa322f5-42ec-455e-a351-9801803dbef4 None None] MFA Rules not processed for user `57367d57bc3a4258993aba820461fa80`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:39.454921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3fa322f5-42ec-455e-a351-9801803dbef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:39.520564 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1353/2683] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:39.525171 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7843f-97ee-465e-aabb-4d268e17c5f5 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.571601 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:39.589147 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7843f-97ee-465e-aabb-4d268e17c5f5 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.594054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad34375-d4e7-4845-8626-c73ceb33ac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.594714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad34375-d4e7-4845-8626-c73ceb33ac4d admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.595001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad34375-d4e7-4845-8626-c73ceb33ac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.595280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad34375-d4e7-4845-8626-c73ceb33ac4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.596019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad34375-d4e7-4845-8626-c73ceb33ac4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.597960 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad34375-d4e7-4845-8626-c73ceb33ac4d admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.695381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1331/2684] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:31:39 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:39.700012 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa322f5-42ec-455e-a351-9801803dbef4 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.710877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa322f5-42ec-455e-a351-9801803dbef4 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.743134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:39.770769 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeac5d-9d12-40de-a79b-0785ee5ecdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.771459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeac5d-9d12-40de-a79b-0785ee5ecdff admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.771747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeac5d-9d12-40de-a79b-0785ee5ecdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.772057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeac5d-9d12-40de-a79b-0785ee5ecdff admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.772762 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbeac5d-9d12-40de-a79b-0785ee5ecdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.774722 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbeac5d-9d12-40de-a79b-0785ee5ecdff admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.843573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1354/2685] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:31:39 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:39.848168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad34375-d4e7-4845-8626-c73ceb33ac4d admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.859505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad34375-d4e7-4845-8626-c73ceb33ac4d admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.864259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cef7b-adeb-48cd-9c37-8d76a117d5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.864926 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cef7b-adeb-48cd-9c37-8d76a117d5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.865212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cef7b-adeb-48cd-9c37-8d76a117d5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.865492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cef7b-adeb-48cd-9c37-8d76a117d5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.866228 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cef7b-adeb-48cd-9c37-8d76a117d5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.867825 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cef7b-adeb-48cd-9c37-8d76a117d5d0 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.879897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1332/2686] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:31:39.884173 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeac5d-9d12-40de-a79b-0785ee5ecdff admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.894971 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeac5d-9d12-40de-a79b-0785ee5ecdff admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.899896 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dde9a-866f-40e3-999b-459a69b3089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.900624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dde9a-866f-40e3-999b-459a69b3089f admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.900923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dde9a-866f-40e3-999b-459a69b3089f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.901200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dde9a-866f-40e3-999b-459a69b3089f admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.902560 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dde9a-866f-40e3-999b-459a69b3089f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.904527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dde9a-866f-40e3-999b-459a69b3089f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.916085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1355/2687] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:39.919587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cef7b-adeb-48cd-9c37-8d76a117d5d0 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.930912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cef7b-adeb-48cd-9c37-8d76a117d5d0 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.936953 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776be59-e39d-4d31-a170-fd4bca8502ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.937952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776be59-e39d-4d31-a170-fd4bca8502ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.938529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776be59-e39d-4d31-a170-fd4bca8502ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.938529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776be59-e39d-4d31-a170-fd4bca8502ed admin admin] PATH_INFO: `/v3/projects/e344215534724177861be5ea545c442b/users/8fe834e883464922a701194546a155c7/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.954785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776be59-e39d-4d31-a170-fd4bca8502ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e344215534724177861be5ea545c442b, user_id=8fe834e883464922a701194546a155c7, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.957485 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776be59-e39d-4d31-a170-fd4bca8502ed admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.042755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1333/2688] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:39 2022] PUT /identity/v3/projects/e344215534724177861be5ea545c442b/users/8fe834e883464922a701194546a155c7/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:40.054591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8321ac0-7396-4152-a00e-fb80fc92f35f None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.054887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8321ac0-7396-4152-a00e-fb80fc92f35f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.055171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8321ac0-7396-4152-a00e-fb80fc92f35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.081513 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-f8321ac0-7396-4152-a00e-fb80fc92f35f None None] MFA Rules not processed for user `8fe834e883464922a701194546a155c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:40.082730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f8321ac0-7396-4152-a00e-fb80fc92f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:40.149515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1356/2689] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:40.154557 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776be59-e39d-4d31-a170-fd4bca8502ed admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.216748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776be59-e39d-4d31-a170-fd4bca8502ed admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.221519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283779-437c-4741-89d3-f7d7d1c92267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.222188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283779-437c-4741-89d3-f7d7d1c92267 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.222477 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283779-437c-4741-89d3-f7d7d1c92267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.222760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283779-437c-4741-89d3-f7d7d1c92267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.223458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b283779-437c-4741-89d3-f7d7d1c92267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:40.225451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b283779-437c-4741-89d3-f7d7d1c92267 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.315658 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1334/2690] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:31:40 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:40.317055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8321ac0-7396-4152-a00e-fb80fc92f35f None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.328153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8321ac0-7396-4152-a00e-fb80fc92f35f None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.384803 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b3827-55f3-421d-9a4a-7976d42dbe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.385484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b3827-55f3-421d-9a4a-7976d42dbe69 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.385767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b3827-55f3-421d-9a4a-7976d42dbe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.386040 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b3827-55f3-421d-9a4a-7976d42dbe69 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.386770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b3827-55f3-421d-9a4a-7976d42dbe69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:40.388767 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b3827-55f3-421d-9a4a-7976d42dbe69 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.494240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1357/2691] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:31:40 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:40.500048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283779-437c-4741-89d3-f7d7d1c92267 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.509346 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283779-437c-4741-89d3-f7d7d1c92267 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.514379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3ef5-9ef9-4f1d-a4c1-3a7852c3eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.515143 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3ef5-9ef9-4f1d-a4c1-3a7852c3eba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.515499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3ef5-9ef9-4f1d-a4c1-3a7852c3eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.515742 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3ef5-9ef9-4f1d-a4c1-3a7852c3eba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.516522 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea3ef5-9ef9-4f1d-a4c1-3a7852c3eba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:40.518275 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea3ef5-9ef9-4f1d-a4c1-3a7852c3eba0 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.529442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1335/2692] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:40.533543 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b3827-55f3-421d-9a4a-7976d42dbe69 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.545026 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b3827-55f3-421d-9a4a-7976d42dbe69 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.549698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620762-6d7f-41d3-83ed-83db7b6b0686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.550587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620762-6d7f-41d3-83ed-83db7b6b0686 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.550869 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620762-6d7f-41d3-83ed-83db7b6b0686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.551143 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620762-6d7f-41d3-83ed-83db7b6b0686 admin admin] PATH_INFO: `/v3/projects/8f8434f00d59488faa3ef4622abf5d57/users/9a82efb5eaa74bbbb248582462a0f496/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.568376 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d620762-6d7f-41d3-83ed-83db7b6b0686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8434f00d59488faa3ef4622abf5d57, user_id=9a82efb5eaa74bbbb248582462a0f496, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:40.571945 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d620762-6d7f-41d3-83ed-83db7b6b0686 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.645214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1358/2693] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:40 2022] PUT /identity/v3/projects/8f8434f00d59488faa3ef4622abf5d57/users/9a82efb5eaa74bbbb248582462a0f496/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:40.649453 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3ef5-9ef9-4f1d-a4c1-3a7852c3eba0 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.663765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3ef5-9ef9-4f1d-a4c1-3a7852c3eba0 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.732691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818ba26-79a6-4650-809f-ebd9c42f410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.732977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818ba26-79a6-4650-809f-ebd9c42f410e admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.733263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818ba26-79a6-4650-809f-ebd9c42f410e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.733544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818ba26-79a6-4650-809f-ebd9c42f410e admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.734355 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818ba26-79a6-4650-809f-ebd9c42f410e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:40.736079 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818ba26-79a6-4650-809f-ebd9c42f410e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.747219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1336/2694] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:40.751488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620762-6d7f-41d3-83ed-83db7b6b0686 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.762527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620762-6d7f-41d3-83ed-83db7b6b0686 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.767273 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d518469-ed32-4a1f-8672-fc1154905e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.768509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d518469-ed32-4a1f-8672-fc1154905e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.768509 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d518469-ed32-4a1f-8672-fc1154905e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.769080 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d518469-ed32-4a1f-8672-fc1154905e43 admin admin] PATH_INFO: `/v3/projects/8f8434f00d59488faa3ef4622abf5d57/users/9a82efb5eaa74bbbb248582462a0f496/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.770654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d518469-ed32-4a1f-8672-fc1154905e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8434f00d59488faa3ef4622abf5d57, user_id=9a82efb5eaa74bbbb248582462a0f496, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:40.773359 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d518469-ed32-4a1f-8672-fc1154905e43 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.775707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:40.791267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1359/2695] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:40 2022] PUT /identity/v3/projects/8f8434f00d59488faa3ef4622abf5d57/users/9a82efb5eaa74bbbb248582462a0f496/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:40.801723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b6668-7f23-433d-aacf-2d5825b9510f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.802110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b6668-7f23-433d-aacf-2d5825b9510f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.802515 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b6668-7f23-433d-aacf-2d5825b9510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.809015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:40.831753 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-491b6668-7f23-433d-aacf-2d5825b9510f None None] MFA Rules not processed for user `9a82efb5eaa74bbbb248582462a0f496`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:40.832923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-491b6668-7f23-433d-aacf-2d5825b9510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:40.904697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1337/2696] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:40.916132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d518469-ed32-4a1f-8672-fc1154905e43 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.917871 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2d518469-ed32-4a1f-8672-fc1154905e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:40.977586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d518469-ed32-4a1f-8672-fc1154905e43 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.981237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bc1da-c32c-4653-b14b-e3b9290cda89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.981889 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bc1da-c32c-4653-b14b-e3b9290cda89 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.982177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bc1da-c32c-4653-b14b-e3b9290cda89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.982496 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bc1da-c32c-4653-b14b-e3b9290cda89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:41.036814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bc1da-c32c-4653-b14b-e3b9290cda89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:41.038257 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bc1da-c32c-4653-b14b-e3b9290cda89 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:41.047056 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1360/2697] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:43.177802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b6668-7f23-433d-aacf-2d5825b9510f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:43.179245 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-491b6668-7f23-433d-aacf-2d5825b9510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:43.191487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b6668-7f23-433d-aacf-2d5825b9510f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:43.195046 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6a5d9-97f5-4faf-8e52-6587ec4844cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:43.195721 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6a5d9-97f5-4faf-8e52-6587ec4844cc service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:43.196047 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6a5d9-97f5-4faf-8e52-6587ec4844cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:43.196332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6a5d9-97f5-4faf-8e52-6587ec4844cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:43.253331 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6a5d9-97f5-4faf-8e52-6587ec4844cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:43.254765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6a5d9-97f5-4faf-8e52-6587ec4844cc service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:43.263829 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1338/2698] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:44.741501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bc1da-c32c-4653-b14b-e3b9290cda89 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:44.750364 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bc1da-c32c-4653-b14b-e3b9290cda89 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:44.754403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0dc38-c32d-49b8-a385-7d5332390488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:44.755046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0dc38-c32d-49b8-a385-7d5332390488 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.755331 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0dc38-c32d-49b8-a385-7d5332390488 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.755610 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0dc38-c32d-49b8-a385-7d5332390488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.764492 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0dc38-c32d-49b8-a385-7d5332390488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:44.765912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0dc38-c32d-49b8-a385-7d5332390488 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:44.775196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1361/2699] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:49.516617 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6a5d9-97f5-4faf-8e52-6587ec4844cc service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:49.577279 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6a5d9-97f5-4faf-8e52-6587ec4844cc service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:49.582031 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:49.582833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:49.583115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:49.583389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] PATH_INFO: `/v3/users/57367d57bc3a4258993aba820461fa80` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:49.584574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=57367d57bc3a4258993aba820461fa80)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:49.586719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:49.758302 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:49.833886 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57367d57bc3a4258993aba820461fa80'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:49.903967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57367d57bc3a4258993aba820461fa80'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:49.916214 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57367d57bc3a4258993aba820461fa80'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:49.916858 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57367d57bc3a4258993aba820461fa80'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:49.924204 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57367d57bc3a4258993aba820461fa80'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:49.930035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1339/2700] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:31:49 2022] DELETE /identity/v3/users/57367d57bc3a4258993aba820461fa80 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:49.934670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf849cf-d572-4c38-98aa-265f6f7bfd36 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:49.935178 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf849cf-d572-4c38-98aa-265f6f7bfd36 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:49.935297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf849cf-d572-4c38-98aa-265f6f7bfd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:49.952349 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-acf849cf-d572-4c38-98aa-265f6f7bfd36 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:49.953551 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-acf849cf-d572-4c38-98aa-265f6f7bfd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:50.010973 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1362/2701] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:50.020868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:50.022443 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:50.079705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866a4f1-9bb5-4465-bf18-b91e659fa0ab admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:50.083330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845aa95-a6f9-4923-9a29-646c98b8fe6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:50.084066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845aa95-a6f9-4923-9a29-646c98b8fe6d service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.084299 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845aa95-a6f9-4923-9a29-646c98b8fe6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.084587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845aa95-a6f9-4923-9a29-646c98b8fe6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.094277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845aa95-a6f9-4923-9a29-646c98b8fe6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:50.095701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845aa95-a6f9-4923-9a29-646c98b8fe6d service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:50.105089 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1340/2702] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:50.556745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf849cf-d572-4c38-98aa-265f6f7bfd36 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:50.558447 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-acf849cf-d572-4c38-98aa-265f6f7bfd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:50.571950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf849cf-d572-4c38-98aa-265f6f7bfd36 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:50.576787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:50.578159 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.578451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.579071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] PATH_INFO: `/v3/projects/a7e833cd197d4b1dbae731f391ef2667` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.580302 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e833cd197d4b1dbae731f391ef2667)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:50.582195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:50.680091 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:50.692505 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e833cd197d4b1dbae731f391ef2667', 'request_id': 'req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:50.698709 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e833cd197d4b1dbae731f391ef2667', 'request_id': 'req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:50.760506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e833cd197d4b1dbae731f391ef2667', 'request_id': 'req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:50.770718 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] The token cache is being invalidate because project a7e833cd197d4b1dbae731f391ef2667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:31:50.770996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:50.771620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:50.773174 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1363/2703] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:31:50 2022] DELETE /identity/v3/projects/a7e833cd197d4b1dbae731f391ef2667 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:50.777866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845aa95-a6f9-4923-9a29-646c98b8fe6d service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:50.787317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845aa95-a6f9-4923-9a29-646c98b8fe6d service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:50.844379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:50.845254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.845539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.845813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] PATH_INFO: `/v3/users/8fe834e883464922a701194546a155c7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.847056 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe834e883464922a701194546a155c7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:50.848993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:50.992386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe834e883464922a701194546a155c7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:50.994758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.070855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe834e883464922a701194546a155c7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:51.083368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe834e883464922a701194546a155c7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:51.084035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe834e883464922a701194546a155c7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:51.091452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe834e883464922a701194546a155c7'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:51.097356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1341/2704] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:31:50 2022] DELETE /identity/v3/users/8fe834e883464922a701194546a155c7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:51.517706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.519214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:51.535617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d575-cdd7-4b57-8cb4-e2e5dcbb4b47 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.592487 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.593380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.593664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.593942 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] PATH_INFO: `/v3/projects/e344215534724177861be5ea545c442b` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.595135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e344215534724177861be5ea545c442b)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:51.597078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:51.705077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e344215534724177861be5ea545c442b', 'request_id': 'req-00df2dc6-0450-4e1c-af80-c80723d9e149'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:51.711457 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e344215534724177861be5ea545c442b', 'request_id': 'req-00df2dc6-0450-4e1c-af80-c80723d9e149'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:51.773389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e344215534724177861be5ea545c442b', 'request_id': 'req-00df2dc6-0450-4e1c-af80-c80723d9e149'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:51.785014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] The token cache is being invalidate because project e344215534724177861be5ea545c442b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:31:51.785298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:51.790132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:51.790132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1364/2705] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:31:51 2022] DELETE /identity/v3/projects/e344215534724177861be5ea545c442b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:51.792151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.793937 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:51.807749 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a4c3d-9ef0-4644-b300-f09348116b3f admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.863784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.864690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.864979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.865262 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] PATH_INFO: `/v3/users/9a82efb5eaa74bbbb248582462a0f496` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.866452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a82efb5eaa74bbbb248582462a0f496)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:51.868420 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:52.078482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a82efb5eaa74bbbb248582462a0f496'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:52.156562 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a82efb5eaa74bbbb248582462a0f496'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:52.169534 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a82efb5eaa74bbbb248582462a0f496'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:52.170208 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a82efb5eaa74bbbb248582462a0f496'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:52.177095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-82b81291-2fb6-43a9-b967-66f6924f6dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a82efb5eaa74bbbb248582462a0f496'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:52.183106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1342/2706] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:31:51 2022] DELETE /identity/v3/users/9a82efb5eaa74bbbb248582462a0f496 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:52.604058 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:52.609290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:52.619171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df2dc6-0450-4e1c-af80-c80723d9e149 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:52.666168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:52.677734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:52.678707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:52.678987 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:52.679261 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] PATH_INFO: `/v3/projects/8f8434f00d59488faa3ef4622abf5d57` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:52.680497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8434f00d59488faa3ef4622abf5d57)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:52.682406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:52.773454 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8434f00d59488faa3ef4622abf5d57', 'request_id': 'req-75f6c3d9-12e6-4c8e-900d-601ed4741859'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:52.780259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8434f00d59488faa3ef4622abf5d57', 'request_id': 'req-75f6c3d9-12e6-4c8e-900d-601ed4741859'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:52.847498 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8434f00d59488faa3ef4622abf5d57', 'request_id': 'req-75f6c3d9-12e6-4c8e-900d-601ed4741859'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:52.857992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] The token cache is being invalidate because project 8f8434f00d59488faa3ef4622abf5d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:31:52.858278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:52.858940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-75f6c3d9-12e6-4c8e-900d-601ed4741859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:31:52.860562 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1365/2707] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:31:52 2022] DELETE /identity/v3/projects/8f8434f00d59488faa3ef4622abf5d57 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:52.865698 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961803-062f-4146-8e8b-1df1fe1d0385 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:52.866178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961803-062f-4146-8e8b-1df1fe1d0385 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:52.866281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961803-062f-4146-8e8b-1df1fe1d0385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:52.886482 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-51961803-062f-4146-8e8b-1df1fe1d0385 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:52.897906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-51961803-062f-4146-8e8b-1df1fe1d0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:52.928139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:52.945376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1343/2708] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:52.953758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06908b-e215-4cd6-bd83-9f16eeeb3d3c None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:52.954078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06908b-e215-4cd6-bd83-9f16eeeb3d3c None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:52.954355 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06908b-e215-4cd6-bd83-9f16eeeb3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:52.974325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-6b06908b-e215-4cd6-bd83-9f16eeeb3d3c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:52.975545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-6b06908b-e215-4cd6-bd83-9f16eeeb3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:52.984022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1366/2709] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:52.992345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961803-062f-4146-8e8b-1df1fe1d0385 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:53.001895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961803-062f-4146-8e8b-1df1fe1d0385 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:53.006723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09054071-9c19-42ba-bac2-6ad047b29a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:53.007586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09054071-9c19-42ba-bac2-6ad047b29a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:53.008115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09054071-9c19-42ba-bac2-6ad047b29a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:53.008860 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09054071-9c19-42ba-bac2-6ad047b29a0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:53.009565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09054071-9c19-42ba-bac2-6ad047b29a0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:53.009879 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09054071-9c19-42ba-bac2-6ad047b29a0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:53.011504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09054071-9c19-42ba-bac2-6ad047b29a0a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:53.023135 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1344/2710] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:53.029180 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06908b-e215-4cd6-bd83-9f16eeeb3d3c None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:53.038558 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06908b-e215-4cd6-bd83-9f16eeeb3d3c None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:53.044018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a23923-e70c-45be-82f6-f1608ccf8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:53.044664 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a23923-e70c-45be-82f6-f1608ccf8828 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:53.044944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a23923-e70c-45be-82f6-f1608ccf8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:53.045255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a23923-e70c-45be-82f6-f1608ccf8828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:53.045928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a23923-e70c-45be-82f6-f1608ccf8828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:53.047817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a23923-e70c-45be-82f6-f1608ccf8828 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:53.170011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1367/2711] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:31:53 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:53.174268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09054071-9c19-42ba-bac2-6ad047b29a0a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:53.184313 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09054071-9c19-42ba-bac2-6ad047b29a0a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:53.248654 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efd82f-1c8a-4186-8c9a-53dadb3ae4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:53.250283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efd82f-1c8a-4186-8c9a-53dadb3ae4be admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:53.250283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efd82f-1c8a-4186-8c9a-53dadb3ae4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:53.250283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efd82f-1c8a-4186-8c9a-53dadb3ae4be admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:53.250563 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efd82f-1c8a-4186-8c9a-53dadb3ae4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:53.252542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efd82f-1c8a-4186-8c9a-53dadb3ae4be admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:53.338109 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1345/2712] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:31:53 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:53.342855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a23923-e70c-45be-82f6-f1608ccf8828 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:53.353435 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a23923-e70c-45be-82f6-f1608ccf8828 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:53.359188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ba15-67c7-4f9d-875b-269a13ee02e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:53.359188 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ba15-67c7-4f9d-875b-269a13ee02e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:53.359526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ba15-67c7-4f9d-875b-269a13ee02e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:53.359833 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ba15-67c7-4f9d-875b-269a13ee02e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:53.360669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562ba15-67c7-4f9d-875b-269a13ee02e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:53.362254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562ba15-67c7-4f9d-875b-269a13ee02e4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:53.373404 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1368/2713] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:53.377471 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efd82f-1c8a-4186-8c9a-53dadb3ae4be admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:53.388123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efd82f-1c8a-4186-8c9a-53dadb3ae4be admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:53.392849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdea72c-211e-41ee-ab2e-8bcffd552a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:53.393523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdea72c-211e-41ee-ab2e-8bcffd552a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:53.393827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdea72c-211e-41ee-ab2e-8bcffd552a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:53.394097 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdea72c-211e-41ee-ab2e-8bcffd552a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:53.394827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdea72c-211e-41ee-ab2e-8bcffd552a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:53.396475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdea72c-211e-41ee-ab2e-8bcffd552a96 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:53.407778 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1346/2714] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:31:53.412346 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ba15-67c7-4f9d-875b-269a13ee02e4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:53.423402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ba15-67c7-4f9d-875b-269a13ee02e4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:53.439132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad5be9-f034-42db-a3d7-0b972df5d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:53.440054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad5be9-f034-42db-a3d7-0b972df5d19b admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:53.445311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad5be9-f034-42db-a3d7-0b972df5d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:53.445311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad5be9-f034-42db-a3d7-0b972df5d19b admin admin] PATH_INFO: `/v3/projects/eb61193d7ccd4038aeb6ddf8ff26cdd0/users/3ac8947a321a463fa03be11bf46b30fd/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:53.455183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad5be9-f034-42db-a3d7-0b972df5d19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb61193d7ccd4038aeb6ddf8ff26cdd0, user_id=3ac8947a321a463fa03be11bf46b30fd, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:53.457909 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad5be9-f034-42db-a3d7-0b972df5d19b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:53.533017 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1369/2715] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:31:53 2022] PUT /identity/v3/projects/eb61193d7ccd4038aeb6ddf8ff26cdd0/users/3ac8947a321a463fa03be11bf46b30fd/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:53.544833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7160a-fa98-4e12-85ea-2b8ce1f9c809 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:53.548433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7160a-fa98-4e12-85ea-2b8ce1f9c809 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:53.548433 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7160a-fa98-4e12-85ea-2b8ce1f9c809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:53.572605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0fb7160a-fa98-4e12-85ea-2b8ce1f9c809 None None] MFA Rules not processed for user `3ac8947a321a463fa03be11bf46b30fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:53.573838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0fb7160a-fa98-4e12-85ea-2b8ce1f9c809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:53.635362 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1347/2716] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:31:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:31:53.647179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad5be9-f034-42db-a3d7-0b972df5d19b admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:53.648975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-50ad5be9-f034-42db-a3d7-0b972df5d19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:53.704570 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad5be9-f034-42db-a3d7-0b972df5d19b admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:53.708084 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c257f-1d47-491d-b910-e1c03e77f3a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '979519f42f7d463bb2ee1d5b0bb72a45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:53.708727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c257f-1d47-491d-b910-e1c03e77f3a4 service glance] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:53.709011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c257f-1d47-491d-b910-e1c03e77f3a4 service glance] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:53.709288 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c257f-1d47-491d-b910-e1c03e77f3a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:53.718294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c257f-1d47-491d-b910-e1c03e77f3a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:53.719727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c257f-1d47-491d-b910-e1c03e77f3a4 service glance] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:53.728374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1370/2717] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:03.632537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:03.724504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:18.137979 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7160a-fa98-4e12-85ea-2b8ce1f9c809 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:18.139708 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0fb7160a-fa98-4e12-85ea-2b8ce1f9c809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:18.305142 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7160a-fa98-4e12-85ea-2b8ce1f9c809 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:18.313270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e580952-7a1a-4c33-b57a-163ff2ad9c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:18.314290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580952-7a1a-4c33-b57a-163ff2ad9c4d service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.314759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580952-7a1a-4c33-b57a-163ff2ad9c4d service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.315367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580952-7a1a-4c33-b57a-163ff2ad9c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.317649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3e580952-7a1a-4c33-b57a-163ff2ad9c4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:18.334787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e580952-7a1a-4c33-b57a-163ff2ad9c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:18.336811 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e580952-7a1a-4c33-b57a-163ff2ad9c4d service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:18.355560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1348/2718] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:28.349688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=56 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:30.927050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c257f-1d47-491d-b910-e1c03e77f3a4 service glance] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:30.928617 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a06c257f-1d47-491d-b910-e1c03e77f3a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:31.026127 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c257f-1d47-491d-b910-e1c03e77f3a4 service glance] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:31.029816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e3c45-20a9-4194-92db-974499288cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:31.030535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e3c45-20a9-4194-92db-974499288cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.030824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e3c45-20a9-4194-92db-974499288cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.031102 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e3c45-20a9-4194-92db-974499288cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.033040 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-776e3c45-20a9-4194-92db-974499288cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:31.134145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e3c45-20a9-4194-92db-974499288cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:31.135850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e3c45-20a9-4194-92db-974499288cd5 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:31.158184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1371/2719] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:34.981605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e580952-7a1a-4c33-b57a-163ff2ad9c4d service nova] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:34.985475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3e580952-7a1a-4c33-b57a-163ff2ad9c4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:35.063997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e580952-7a1a-4c33-b57a-163ff2ad9c4d service nova] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.069091 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5a92e-9a77-42fb-bd1e-ef20be5366a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.069777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5a92e-9a77-42fb-bd1e-ef20be5366a3 service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.070065 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5a92e-9a77-42fb-bd1e-ef20be5366a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.070344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5a92e-9a77-42fb-bd1e-ef20be5366a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.072220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bae5a92e-9a77-42fb-bd1e-ef20be5366a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:35.087569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5a92e-9a77-42fb-bd1e-ef20be5366a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.092575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5a92e-9a77-42fb-bd1e-ef20be5366a3 service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.100153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1349/2720] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:35.155169 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e3c45-20a9-4194-92db-974499288cd5 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.157936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-776e3c45-20a9-4194-92db-974499288cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:35.178618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e3c45-20a9-4194-92db-974499288cd5 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.184473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.185451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.185831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.186204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] PATH_INFO: `/v3/users/37a7776277ca42eba4476242438fbf6d` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.187592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a7776277ca42eba4476242438fbf6d)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.189741 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.404371 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:35.406184 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a7776277ca42eba4476242438fbf6d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:35.497428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a7776277ca42eba4476242438fbf6d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:35.511311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a7776277ca42eba4476242438fbf6d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:35.512145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a7776277ca42eba4476242438fbf6d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:35.519706 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f46cf439-7e4d-4498-a1fd-ce93fcc7aed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a7776277ca42eba4476242438fbf6d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:35.527228 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1372/2721] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:32:35 2022] DELETE /identity/v3/users/37a7776277ca42eba4476242438fbf6d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:35.837876 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5a92e-9a77-42fb-bd1e-ef20be5366a3 service placement] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.849310 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5a92e-9a77-42fb-bd1e-ef20be5366a3 service placement] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.919510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.920435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.920722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.920996 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] PATH_INFO: `/v3/projects/afa347af05aa4e40b5960fd0aea87c54` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.922322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa347af05aa4e40b5960fd0aea87c54)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.924288 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.072775 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa347af05aa4e40b5960fd0aea87c54', 'request_id': 'req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:36.079967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa347af05aa4e40b5960fd0aea87c54', 'request_id': 'req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:36.150391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa347af05aa4e40b5960fd0aea87c54', 'request_id': 'req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:36.162303 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] The token cache is being invalidate because project afa347af05aa4e40b5960fd0aea87c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:32:36.162633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:36.163388 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-8652ed46-6ad5-4f83-9520-7ff7d98f9a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:36.165022 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1350/2722] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:32:35 2022] DELETE /identity/v3/projects/afa347af05aa4e40b5960fd0aea87c54 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:36.171294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb291d9-7615-4ace-bb36-59dbc0236cc2 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.179471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb291d9-7615-4ace-bb36-59dbc0236cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.179471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb291d9-7615-4ace-bb36-59dbc0236cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.235974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-1fb291d9-7615-4ace-bb36-59dbc0236cc2 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:36.237591 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-1fb291d9-7615-4ace-bb36-59dbc0236cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:36.302716 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1373/2723] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:36.311400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649f92b-8828-4615-92aa-1fad5a13e364 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.311748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649f92b-8828-4615-92aa-1fad5a13e364 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.312201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649f92b-8828-4615-92aa-1fad5a13e364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.334587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0649f92b-8828-4615-92aa-1fad5a13e364 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:36.336023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0649f92b-8828-4615-92aa-1fad5a13e364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:36.345930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1351/2724] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:36.352361 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb291d9-7615-4ace-bb36-59dbc0236cc2 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.365238 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb291d9-7615-4ace-bb36-59dbc0236cc2 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.375350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69678bff-cb83-4e42-ba40-23fa3a2db27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.376775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69678bff-cb83-4e42-ba40-23fa3a2db27e admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.377254 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69678bff-cb83-4e42-ba40-23fa3a2db27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.383286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69678bff-cb83-4e42-ba40-23fa3a2db27e admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.383286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69678bff-cb83-4e42-ba40-23fa3a2db27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:36.383286 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69678bff-cb83-4e42-ba40-23fa3a2db27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.384049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69678bff-cb83-4e42-ba40-23fa3a2db27e admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.407192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1374/2725] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:36.412265 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649f92b-8828-4615-92aa-1fad5a13e364 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.425573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649f92b-8828-4615-92aa-1fad5a13e364 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.430747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec2d5b-2c30-4b7d-a3d0-a58d866c4336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.431430 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2d5b-2c30-4b7d-a3d0-a58d866c4336 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.431718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2d5b-2c30-4b7d-a3d0-a58d866c4336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.432034 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2d5b-2c30-4b7d-a3d0-a58d866c4336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.432774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec2d5b-2c30-4b7d-a3d0-a58d866c4336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.434713 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec2d5b-2c30-4b7d-a3d0-a58d866c4336 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.449110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.547560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1352/2726] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:32:36 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:36.552467 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69678bff-cb83-4e42-ba40-23fa3a2db27e admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.572112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69678bff-cb83-4e42-ba40-23fa3a2db27e admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.640291 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8f30-3f29-41c0-8c41-df2a6c3d1b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.640986 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8f30-3f29-41c0-8c41-df2a6c3d1b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.641271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8f30-3f29-41c0-8c41-df2a6c3d1b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.641549 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8f30-3f29-41c0-8c41-df2a6c3d1b31 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.642253 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d8f30-3f29-41c0-8c41-df2a6c3d1b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.644276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d8f30-3f29-41c0-8c41-df2a6c3d1b31 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.745765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1375/2727] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:32:36 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:36.750464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec2d5b-2c30-4b7d-a3d0-a58d866c4336 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.762156 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec2d5b-2c30-4b7d-a3d0-a58d866c4336 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.768863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59cb1-ac62-47f9-afdd-0a4b2d9636d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.770047 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59cb1-ac62-47f9-afdd-0a4b2d9636d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.770541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59cb1-ac62-47f9-afdd-0a4b2d9636d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.771020 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59cb1-ac62-47f9-afdd-0a4b2d9636d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.772351 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d59cb1-ac62-47f9-afdd-0a4b2d9636d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.775298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d59cb1-ac62-47f9-afdd-0a4b2d9636d1 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.787850 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1353/2728] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:32:36.792069 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8f30-3f29-41c0-8c41-df2a6c3d1b31 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.803040 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8f30-3f29-41c0-8c41-df2a6c3d1b31 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.807901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b9762-75cf-4b8f-a95d-bfa7d0f14800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.808599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b9762-75cf-4b8f-a95d-bfa7d0f14800 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.808913 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b9762-75cf-4b8f-a95d-bfa7d0f14800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.809190 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b9762-75cf-4b8f-a95d-bfa7d0f14800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.809923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b9762-75cf-4b8f-a95d-bfa7d0f14800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.811568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b9762-75cf-4b8f-a95d-bfa7d0f14800 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.814202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.826168 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1376/2729] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:32:36.830709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59cb1-ac62-47f9-afdd-0a4b2d9636d1 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.842472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59cb1-ac62-47f9-afdd-0a4b2d9636d1 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.847285 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665baa75-84f5-40f7-9616-828b70658cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.848263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665baa75-84f5-40f7-9616-828b70658cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.848550 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665baa75-84f5-40f7-9616-828b70658cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.848831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665baa75-84f5-40f7-9616-828b70658cde admin admin] PATH_INFO: `/v3/projects/7e67e4d57a904f8eb14d2e8b8100cef1/users/a3db71a87efc459b8617e9632fcd59e6/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.868997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665baa75-84f5-40f7-9616-828b70658cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e67e4d57a904f8eb14d2e8b8100cef1, user_id=a3db71a87efc459b8617e9632fcd59e6, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.873931 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665baa75-84f5-40f7-9616-828b70658cde admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.933544 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1354/2730] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:32:36 2022] PUT /identity/v3/projects/7e67e4d57a904f8eb14d2e8b8100cef1/users/a3db71a87efc459b8617e9632fcd59e6/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:32:36.939566 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfea03-03af-4d72-9fb1-8cf4cc1b7473 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.940133 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfea03-03af-4d72-9fb1-8cf4cc1b7473 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.940634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfea03-03af-4d72-9fb1-8cf4cc1b7473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.968256 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7dbfea03-03af-4d72-9fb1-8cf4cc1b7473 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:36.970158 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7dbfea03-03af-4d72-9fb1-8cf4cc1b7473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:37.046259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1377/2731] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:37.058115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665baa75-84f5-40f7-9616-828b70658cde admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.060377 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-665baa75-84f5-40f7-9616-828b70658cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:37.129090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665baa75-84f5-40f7-9616-828b70658cde admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:37.133126 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45ba3c-49ba-4afa-8088-3180936e24a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:37.133803 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45ba3c-49ba-4afa-8088-3180936e24a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:37.134088 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45ba3c-49ba-4afa-8088-3180936e24a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:37.134367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45ba3c-49ba-4afa-8088-3180936e24a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:37.144157 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45ba3c-49ba-4afa-8088-3180936e24a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:37.145635 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45ba3c-49ba-4afa-8088-3180936e24a6 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:37.156918 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1355/2732] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:43.910356 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56946-a8b9-419b-a927-9e1c320835af None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.910967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56946-a8b9-419b-a927-9e1c320835af None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.911251 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56946-a8b9-419b-a927-9e1c320835af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.952604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-93c56946-a8b9-419b-a927-9e1c320835af None None] MFA Rules not processed for user `a3db71a87efc459b8617e9632fcd59e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:43.953636 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-93c56946-a8b9-419b-a927-9e1c320835af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:44.033374 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1378/2733] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:32:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:44.050573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45ba3c-49ba-4afa-8088-3180936e24a6 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.052066 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0a45ba3c-49ba-4afa-8088-3180936e24a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:44.132338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45ba3c-49ba-4afa-8088-3180936e24a6 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.139618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ba4dc-6853-41d1-9249-58daeca8c584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.140330 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ba4dc-6853-41d1-9249-58daeca8c584 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.140614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ba4dc-6853-41d1-9249-58daeca8c584 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.140910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ba4dc-6853-41d1-9249-58daeca8c584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.150558 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ba4dc-6853-41d1-9249-58daeca8c584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.152824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ba4dc-6853-41d1-9249-58daeca8c584 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.162616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1356/2734] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:44.320821 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56946-a8b9-419b-a927-9e1c320835af None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.323101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-93c56946-a8b9-419b-a927-9e1c320835af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:44.337887 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56946-a8b9-419b-a927-9e1c320835af None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.342577 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.343474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.343758 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.344065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] PATH_INFO: `/v3/users/3ac8947a321a463fa03be11bf46b30fd` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.345308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac8947a321a463fa03be11bf46b30fd)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.347327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.629727 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac8947a321a463fa03be11bf46b30fd'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:44.725683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac8947a321a463fa03be11bf46b30fd'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:44.746601 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac8947a321a463fa03be11bf46b30fd'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:44.747505 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac8947a321a463fa03be11bf46b30fd'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:44.785274 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac8947a321a463fa03be11bf46b30fd'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:44.788975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.796111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1379/2735] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:32:44 2022] DELETE /identity/v3/users/3ac8947a321a463fa03be11bf46b30fd => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:32:44.801682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f1a3-512a-4bf7-a499-084c7d1281f0 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.801942 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f1a3-512a-4bf7-a499-084c7d1281f0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.802252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f1a3-512a-4bf7-a499-084c7d1281f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.849535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-9c23f1a3-512a-4bf7-a499-084c7d1281f0 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:44.849535 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9c23f1a3-512a-4bf7-a499-084c7d1281f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:44.886671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.906970 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1357/2736] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:44.921458 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.923483 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:45.167007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a231-6635-4682-82ce-51fafee82586 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.173335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3c78e-c9a1-4a03-a8b7-b2fb86f54549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.174587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3c78e-c9a1-4a03-a8b7-b2fb86f54549 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.174974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3c78e-c9a1-4a03-a8b7-b2fb86f54549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.175356 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3c78e-c9a1-4a03-a8b7-b2fb86f54549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.187694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3c78e-c9a1-4a03-a8b7-b2fb86f54549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.189553 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3c78e-c9a1-4a03-a8b7-b2fb86f54549 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:45.206606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1380/2737] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:45.810078 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23f1a3-512a-4bf7-a499-084c7d1281f0 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.813363 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-9c23f1a3-512a-4bf7-a499-084c7d1281f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:45.829794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23f1a3-512a-4bf7-a499-084c7d1281f0 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.843842 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.847827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.847827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.847827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] PATH_INFO: `/v3/projects/eb61193d7ccd4038aeb6ddf8ff26cdd0` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.848641 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb61193d7ccd4038aeb6ddf8ff26cdd0)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.851261 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.063024 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb61193d7ccd4038aeb6ddf8ff26cdd0', 'request_id': 'req-3ded9583-a5ef-4d3b-88a4-733c35f93a84'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:46.071501 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb61193d7ccd4038aeb6ddf8ff26cdd0', 'request_id': 'req-3ded9583-a5ef-4d3b-88a4-733c35f93a84'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:46.199027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb61193d7ccd4038aeb6ddf8ff26cdd0', 'request_id': 'req-3ded9583-a5ef-4d3b-88a4-733c35f93a84'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:46.202467 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] The token cache is being invalidate because project eb61193d7ccd4038aeb6ddf8ff26cdd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:32:46.202764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:46.203545 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3ded9583-a5ef-4d3b-88a4-733c35f93a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:46.205590 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1358/2738] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:32:45 2022] DELETE /identity/v3/projects/eb61193d7ccd4038aeb6ddf8ff26cdd0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:32:46.213630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52a960-b9aa-4f4c-afa9-5b135c2a0dca None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.214525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52a960-b9aa-4f4c-afa9-5b135c2a0dca None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.214724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52a960-b9aa-4f4c-afa9-5b135c2a0dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.241914 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-be52a960-b9aa-4f4c-afa9-5b135c2a0dca None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:46.243443 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-be52a960-b9aa-4f4c-afa9-5b135c2a0dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:46.360120 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1381/2739] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:46.366122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d2c7-daf5-4010-ad1b-6dc764963d2c None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.366122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d2c7-daf5-4010-ad1b-6dc764963d2c None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.366449 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d2c7-daf5-4010-ad1b-6dc764963d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.404526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0348d2c7-daf5-4010-ad1b-6dc764963d2c None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:46.405863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0348d2c7-daf5-4010-ad1b-6dc764963d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:46.425973 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1359/2740] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:46.426650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52a960-b9aa-4f4c-afa9-5b135c2a0dca None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.439259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52a960-b9aa-4f4c-afa9-5b135c2a0dca None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.447249 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a22e49-b99b-406c-9083-52db8dcc7ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.448754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a22e49-b99b-406c-9083-52db8dcc7ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.449045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a22e49-b99b-406c-9083-52db8dcc7ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.449324 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a22e49-b99b-406c-9083-52db8dcc7ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.450116 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a22e49-b99b-406c-9083-52db8dcc7ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:46.450428 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a22e49-b99b-406c-9083-52db8dcc7ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.454011 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a22e49-b99b-406c-9083-52db8dcc7ad3 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.473204 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1382/2741] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:46.475768 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d2c7-daf5-4010-ad1b-6dc764963d2c None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.488980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d2c7-daf5-4010-ad1b-6dc764963d2c None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.496106 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7101f7c-1083-4d36-b0f3-e29377e68ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.496821 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101f7c-1083-4d36-b0f3-e29377e68ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.497118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101f7c-1083-4d36-b0f3-e29377e68ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.497382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101f7c-1083-4d36-b0f3-e29377e68ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.498118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7101f7c-1083-4d36-b0f3-e29377e68ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.500158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7101f7c-1083-4d36-b0f3-e29377e68ff9 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.635733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1360/2742] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:32:46 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:46.637877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a22e49-b99b-406c-9083-52db8dcc7ad3 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.663285 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a22e49-b99b-406c-9083-52db8dcc7ad3 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.800530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d42b6-58d2-4f4d-85a1-9fea647f1d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.801707 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d42b6-58d2-4f4d-85a1-9fea647f1d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.807154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d42b6-58d2-4f4d-85a1-9fea647f1d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.807154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d42b6-58d2-4f4d-85a1-9fea647f1d3c admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.807154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d42b6-58d2-4f4d-85a1-9fea647f1d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.808555 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d42b6-58d2-4f4d-85a1-9fea647f1d3c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.948695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1383/2743] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:32:46 2022] POST /identity/v3/users => generated 287 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:32:46.953509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7101f7c-1083-4d36-b0f3-e29377e68ff9 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.968822 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7101f7c-1083-4d36-b0f3-e29377e68ff9 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.975052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d2ada-54d1-4129-b19b-7a180f65b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.976267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d2ada-54d1-4129-b19b-7a180f65b735 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.976799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d2ada-54d1-4129-b19b-7a180f65b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.977435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d2ada-54d1-4129-b19b-7a180f65b735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.979093 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d2ada-54d1-4129-b19b-7a180f65b735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.981343 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d2ada-54d1-4129-b19b-7a180f65b735 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.996582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1361/2744] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:32:47.001877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d42b6-58d2-4f4d-85a1-9fea647f1d3c admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.015730 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d42b6-58d2-4f4d-85a1-9fea647f1d3c admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.024211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df97e4-12ba-4074-97a8-e93911ed6640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.025546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df97e4-12ba-4074-97a8-e93911ed6640 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.026656 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df97e4-12ba-4074-97a8-e93911ed6640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.027137 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df97e4-12ba-4074-97a8-e93911ed6640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.028488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df97e4-12ba-4074-97a8-e93911ed6640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.030904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df97e4-12ba-4074-97a8-e93911ed6640 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:47.045292 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1384/2745] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:32:47.050198 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d2ada-54d1-4129-b19b-7a180f65b735 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.066510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d2ada-54d1-4129-b19b-7a180f65b735 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.073863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe96c8-1812-4837-a3f0-f75d8abc90a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.075619 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe96c8-1812-4837-a3f0-f75d8abc90a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.076221 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe96c8-1812-4837-a3f0-f75d8abc90a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.077035 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe96c8-1812-4837-a3f0-f75d8abc90a6 admin admin] PATH_INFO: `/v3/projects/cd8063a4040647c6aa5c0d6e00447d25/users/e76d0fd7c12740edade738e563cbe17c/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.108553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe96c8-1812-4837-a3f0-f75d8abc90a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8063a4040647c6aa5c0d6e00447d25, user_id=e76d0fd7c12740edade738e563cbe17c, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.114826 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe96c8-1812-4837-a3f0-f75d8abc90a6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:47.205251 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1362/2746] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:32:47 2022] PUT /identity/v3/projects/cd8063a4040647c6aa5c0d6e00447d25/users/e76d0fd7c12740edade738e563cbe17c/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:47.282194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f3ab5-8da6-4616-a404-241cc854ea88 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.284683 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f3ab5-8da6-4616-a404-241cc854ea88 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.287464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f3ab5-8da6-4616-a404-241cc854ea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.334979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:47.354520 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-296f3ab5-8da6-4616-a404-241cc854ea88 None None] MFA Rules not processed for user `e76d0fd7c12740edade738e563cbe17c`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:47.356752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-296f3ab5-8da6-4616-a404-241cc854ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:47.543838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1385/2747] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:32:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:47.569260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe96c8-1812-4837-a3f0-f75d8abc90a6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.572277 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-cbfe96c8-1812-4837-a3f0-f75d8abc90a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:47.677703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe96c8-1812-4837-a3f0-f75d8abc90a6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.682599 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3da742-1eb9-43c5-9a26-5fbc46862f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.683761 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3da742-1eb9-43c5-9a26-5fbc46862f99 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.684320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3da742-1eb9-43c5-9a26-5fbc46862f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.684831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3da742-1eb9-43c5-9a26-5fbc46862f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.697993 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3da742-1eb9-43c5-9a26-5fbc46862f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.699461 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3da742-1eb9-43c5-9a26-5fbc46862f99 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:47.715777 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1363/2748] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:47.720948 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e094-1dc0-4858-a481-d9e23274cc49 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.721237 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e094-1dc0-4858-a481-d9e23274cc49 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.721488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e094-1dc0-4858-a481-d9e23274cc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.740723 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3da742-1eb9-43c5-9a26-5fbc46862f99 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.742098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d8b9e094-1dc0-4858-a481-d9e23274cc49 None None] MFA Rules not processed for user `a3db71a87efc459b8617e9632fcd59e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:47.743795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d8b9e094-1dc0-4858-a481-d9e23274cc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:47.757924 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:47.823515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1386/2749] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:32:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:47.832951 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3da742-1eb9-43c5-9a26-5fbc46862f99 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.837911 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.839335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.840263 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.840580 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] PATH_INFO: `/v3/users/e76d0fd7c12740edade738e563cbe17c` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.841959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76d0fd7c12740edade738e563cbe17c)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.843936 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.113766 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76d0fd7c12740edade738e563cbe17c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:48.213180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76d0fd7c12740edade738e563cbe17c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:48.235344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76d0fd7c12740edade738e563cbe17c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:48.236186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76d0fd7c12740edade738e563cbe17c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:48.244814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c70ea86d-574f-4897-808b-f1fc07071cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76d0fd7c12740edade738e563cbe17c'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:48.252850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9e094-1dc0-4858-a481-d9e23274cc49 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.253734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1364/2750] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:32:47 2022] DELETE /identity/v3/users/e76d0fd7c12740edade738e563cbe17c => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:32:48.258367 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883994d-5520-4d98-9843-6042d4dba319 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.258731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883994d-5520-4d98-9843-6042d4dba319 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.258986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883994d-5520-4d98-9843-6042d4dba319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.262966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d8b9e094-1dc0-4858-a481-d9e23274cc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:48.278344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-e883994d-5520-4d98-9843-6042d4dba319 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:48.279921 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e883994d-5520-4d98-9843-6042d4dba319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:48.337994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9e094-1dc0-4858-a481-d9e23274cc49 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.355797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1365/2751] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:32:48.369250 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883994d-5520-4d98-9843-6042d4dba319 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.371912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-e883994d-5520-4d98-9843-6042d4dba319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:48.419408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7c4a0-9532-48b3-b83e-a45c13b0c1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.420381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7c4a0-9532-48b3-b83e-a45c13b0c1cb service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.420808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7c4a0-9532-48b3-b83e-a45c13b0c1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.421092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7c4a0-9532-48b3-b83e-a45c13b0c1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.422962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-30f7c4a0-9532-48b3-b83e-a45c13b0c1cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:48.435130 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7c4a0-9532-48b3-b83e-a45c13b0c1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.436684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7c4a0-9532-48b3-b83e-a45c13b0c1cb service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.440004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:48.455915 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1387/2752] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:48.481317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883994d-5520-4d98-9843-6042d4dba319 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.487906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cc17f-515a-4566-8498-f2218312acf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.490184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cc17f-515a-4566-8498-f2218312acf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.490184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cc17f-515a-4566-8498-f2218312acf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.490184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cc17f-515a-4566-8498-f2218312acf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.501756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cc17f-515a-4566-8498-f2218312acf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.503610 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cc17f-515a-4566-8498-f2218312acf7 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.521990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1366/2753] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:49.136714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7c4a0-9532-48b3-b83e-a45c13b0c1cb service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:49.136714 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-30f7c4a0-9532-48b3-b83e-a45c13b0c1cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:49.150142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=100 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:49.157504 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7c4a0-9532-48b3-b83e-a45c13b0c1cb service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:49.163380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:49.164503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:49.164910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:49.165407 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] PATH_INFO: `/v3/projects/cd8063a4040647c6aa5c0d6e00447d25` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:49.167956 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8063a4040647c6aa5c0d6e00447d25)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:49.170922 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:49.305869 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8063a4040647c6aa5c0d6e00447d25', 'request_id': 'req-85d94a24-667d-483e-bb44-2e009718a08a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:49.311967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8063a4040647c6aa5c0d6e00447d25', 'request_id': 'req-85d94a24-667d-483e-bb44-2e009718a08a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:49.412691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8063a4040647c6aa5c0d6e00447d25', 'request_id': 'req-85d94a24-667d-483e-bb44-2e009718a08a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:49.425911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] The token cache is being invalidate because project cd8063a4040647c6aa5c0d6e00447d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:32:49.426317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:49.427045 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-85d94a24-667d-483e-bb44-2e009718a08a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:49.428777 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1388/2754] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:32:49 2022] DELETE /identity/v3/projects/cd8063a4040647c6aa5c0d6e00447d25 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:52.433834 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cc17f-515a-4566-8498-f2218312acf7 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.437152 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-718cc17f-515a-4566-8498-f2218312acf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:52.565907 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cc17f-515a-4566-8498-f2218312acf7 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:52.631037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651af55-ba3f-4964-84c0-9555b30d4df1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:52.631848 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651af55-ba3f-4964-84c0-9555b30d4df1 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:52.632258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651af55-ba3f-4964-84c0-9555b30d4df1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:52.632629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651af55-ba3f-4964-84c0-9555b30d4df1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:52.634703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b651af55-ba3f-4964-84c0-9555b30d4df1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:52.696493 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651af55-ba3f-4964-84c0-9555b30d4df1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:52.698795 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651af55-ba3f-4964-84c0-9555b30d4df1 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:52.709067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1367/2755] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:59.422518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:02.704672 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=91 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:04.409618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9762-ac54-4e7f-b9a3-e733fe6964a1 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.410162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9762-ac54-4e7f-b9a3-e733fe6964a1 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.410290 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9762-ac54-4e7f-b9a3-e733fe6964a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.430096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-351f9762-ac54-4e7f-b9a3-e733fe6964a1 None None] MFA Rules not processed for user `14bd9be0202b433cb1fa8be6afee8ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:04.431282 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-351f9762-ac54-4e7f-b9a3-e733fe6964a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:04.438535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1389/2756] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:33:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:33:04.770868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651af55-ba3f-4964-84c0-9555b30d4df1 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:04.772328 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b651af55-ba3f-4964-84c0-9555b30d4df1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:04.830624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651af55-ba3f-4964-84c0-9555b30d4df1 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:04.834455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b634-907f-487c-ab01-11189b7e28b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:04.837374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b634-907f-487c-ab01-11189b7e28b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.837374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b634-907f-487c-ab01-11189b7e28b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.837374 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b634-907f-487c-ab01-11189b7e28b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.838173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0de9b634-907f-487c-ab01-11189b7e28b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:04.847995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9b634-907f-487c-ab01-11189b7e28b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:04.849441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9b634-907f-487c-ab01-11189b7e28b6 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:04.858153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1368/2757] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:14.425059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:14.854075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=26 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:23.539018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9762-ac54-4e7f-b9a3-e733fe6964a1 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:23.549452 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9762-ac54-4e7f-b9a3-e733fe6964a1 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:23.553003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5899fe1-d06e-474f-86ca-5ad7fa3518f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:23.553661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899fe1-d06e-474f-86ca-5ad7fa3518f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.553937 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899fe1-d06e-474f-86ca-5ad7fa3518f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.554218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899fe1-d06e-474f-86ca-5ad7fa3518f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.556640 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e5899fe1-d06e-474f-86ca-5ad7fa3518f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:23.622624 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5899fe1-d06e-474f-86ca-5ad7fa3518f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:23.624259 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5899fe1-d06e-474f-86ca-5ad7fa3518f8 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:23.634065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1390/2758] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:28.038270 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b634-907f-487c-ab01-11189b7e28b6 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:28.039731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0de9b634-907f-487c-ab01-11189b7e28b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:28.129990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b634-907f-487c-ab01-11189b7e28b6 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:28.135305 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37121-378a-41be-aad6-a538dfa7f11f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:28.135992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37121-378a-41be-aad6-a538dfa7f11f service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.136280 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37121-378a-41be-aad6-a538dfa7f11f service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.136560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37121-378a-41be-aad6-a538dfa7f11f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.138332 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-31e37121-378a-41be-aad6-a538dfa7f11f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:28.150353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e37121-378a-41be-aad6-a538dfa7f11f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:28.152030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e37121-378a-41be-aad6-a538dfa7f11f service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:28.161891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1369/2759] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:33.629547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=30 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:38.157656 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=41 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:38.842792 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5899fe1-d06e-474f-86ca-5ad7fa3518f8 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:38.844260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e5899fe1-d06e-474f-86ca-5ad7fa3518f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:38.855676 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5899fe1-d06e-474f-86ca-5ad7fa3518f8 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:38.859216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac266a7-f591-44da-95b6-9b39b7f1990e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:38.859851 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac266a7-f591-44da-95b6-9b39b7f1990e service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:38.860172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac266a7-f591-44da-95b6-9b39b7f1990e service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:38.860447 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac266a7-f591-44da-95b6-9b39b7f1990e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:38.862157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0ac266a7-f591-44da-95b6-9b39b7f1990e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:38.919123 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac266a7-f591-44da-95b6-9b39b7f1990e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:38.920592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac266a7-f591-44da-95b6-9b39b7f1990e service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:38.929485 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1391/2760] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:39.862614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37121-378a-41be-aad6-a538dfa7f11f service placement] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:39.864342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-31e37121-378a-41be-aad6-a538dfa7f11f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:39.955057 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37121-378a-41be-aad6-a538dfa7f11f service placement] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:39.964112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaedc3-25bc-4b7c-b2dd-629b6149290d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:39.964112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaedc3-25bc-4b7c-b2dd-629b6149290d service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:39.964112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaedc3-25bc-4b7c-b2dd-629b6149290d service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:39.964112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaedc3-25bc-4b7c-b2dd-629b6149290d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:39.964572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-edeaedc3-25bc-4b7c-b2dd-629b6149290d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:39.976553 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaedc3-25bc-4b7c-b2dd-629b6149290d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:39.978428 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaedc3-25bc-4b7c-b2dd-629b6149290d service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:39.989312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1370/2761] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:45.547765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac266a7-f591-44da-95b6-9b39b7f1990e service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:45.556449 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac266a7-f591-44da-95b6-9b39b7f1990e service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:45.560110 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a0d4-4c45-4a61-911b-17ee034ddcc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:45.560752 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a0d4-4c45-4a61-911b-17ee034ddcc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:45.561036 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a0d4-4c45-4a61-911b-17ee034ddcc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:45.561310 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a0d4-4c45-4a61-911b-17ee034ddcc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:45.563054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ec92a0d4-4c45-4a61-911b-17ee034ddcc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:45.624654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92a0d4-4c45-4a61-911b-17ee034ddcc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:45.626046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92a0d4-4c45-4a61-911b-17ee034ddcc1 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:45.635411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1392/2762] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:49.229786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaedc3-25bc-4b7c-b2dd-629b6149290d service nova] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:49.241974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaedc3-25bc-4b7c-b2dd-629b6149290d service nova] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:49.247224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419c37a-5f23-4971-a6f7-c80dc1bb8e67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:49.247896 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c37a-5f23-4971-a6f7-c80dc1bb8e67 service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:49.248184 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c37a-5f23-4971-a6f7-c80dc1bb8e67 service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:49.248465 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c37a-5f23-4971-a6f7-c80dc1bb8e67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:49.250371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c419c37a-5f23-4971-a6f7-c80dc1bb8e67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:49.262692 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419c37a-5f23-4971-a6f7-c80dc1bb8e67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:49.267287 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419c37a-5f23-4971-a6f7-c80dc1bb8e67 service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:49.275211 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1371/2763] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:33:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:33:53.199181 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a0d4-4c45-4a61-911b-17ee034ddcc1 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:53.200771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ec92a0d4-4c45-4a61-911b-17ee034ddcc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:53.214315 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a0d4-4c45-4a61-911b-17ee034ddcc1 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:53.218928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:53.219805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:53.220124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:53.220522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] PATH_INFO: `/v3/users/8446bcbe46d041789a0a7c5c270fd7ef` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:53.221724 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8446bcbe46d041789a0a7c5c270fd7ef)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:53.223669 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:53.515612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8446bcbe46d041789a0a7c5c270fd7ef'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:53.616568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8446bcbe46d041789a0a7c5c270fd7ef'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:53.628959 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8446bcbe46d041789a0a7c5c270fd7ef'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:53.629604 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8446bcbe46d041789a0a7c5c270fd7ef'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:53.636461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8446bcbe46d041789a0a7c5c270fd7ef'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:53.642383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1393/2764] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:33:53 2022] DELETE /identity/v3/users/8446bcbe46d041789a0a7c5c270fd7ef => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:33:53.955144 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419c37a-5f23-4971-a6f7-c80dc1bb8e67 service placement] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:53.967375 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419c37a-5f23-4971-a6f7-c80dc1bb8e67 service placement] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:54.024782 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:54.025642 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:54.025929 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:54.026209 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] PATH_INFO: `/v3/projects/a67e5bfde6ef4a358150b1ba035d5f1a` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:54.027379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a67e5bfde6ef4a358150b1ba035d5f1a)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:54.029318 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:54.113095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'request_id': 'req-b63de795-c3a5-40d9-8d88-42d9b6e044d5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:54.119102 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'request_id': 'req-b63de795-c3a5-40d9-8d88-42d9b6e044d5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:54.199551 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67e5bfde6ef4a358150b1ba035d5f1a', 'request_id': 'req-b63de795-c3a5-40d9-8d88-42d9b6e044d5'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:54.204582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:54.210989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] The token cache is being invalidate because project a67e5bfde6ef4a358150b1ba035d5f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:33:54.211278 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:54.212549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:54.214162 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1372/2765] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:33:53 2022] DELETE /identity/v3/projects/a67e5bfde6ef4a358150b1ba035d5f1a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:33:54.218470 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:54.219900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:54.229150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:54.233211 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92d95f-a0c1-4ae6-9e57-431616bfdaf8 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:54.288928 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:54.289854 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:54.290139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:54.290413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] PATH_INFO: `/v3/users/8a982aff50404a049a242fb7d0460a51` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:54.291583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a982aff50404a049a242fb7d0460a51)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:54.293506 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:54.561882 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a982aff50404a049a242fb7d0460a51'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:54.633815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a982aff50404a049a242fb7d0460a51'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:54.645991 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a982aff50404a049a242fb7d0460a51'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:54.646654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a982aff50404a049a242fb7d0460a51'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:54.653618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-0b530c93-85dd-472d-a8c9-9dbb318b1f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a982aff50404a049a242fb7d0460a51'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:54.659431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1394/2766] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:33:54 2022] DELETE /identity/v3/users/8a982aff50404a049a242fb7d0460a51 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:33:54.904456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:54.905967 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:54.919506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63de795-c3a5-40d9-8d88-42d9b6e044d5 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:54.976771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:54.977669 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:54.977958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:54.978237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] PATH_INFO: `/v3/projects/8741b1713bfc4c5e8147e7912d80635b` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:54.979445 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8741b1713bfc4c5e8147e7912d80635b)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:54.981385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:55.129432 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8741b1713bfc4c5e8147e7912d80635b', 'request_id': 'req-39a93863-797b-4b6b-8373-e6a84d8e17a6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:55.136154 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8741b1713bfc4c5e8147e7912d80635b', 'request_id': 'req-39a93863-797b-4b6b-8373-e6a84d8e17a6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:55.233987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8741b1713bfc4c5e8147e7912d80635b', 'request_id': 'req-39a93863-797b-4b6b-8373-e6a84d8e17a6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:55.246290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] The token cache is being invalidate because project 8741b1713bfc4c5e8147e7912d80635b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:33:55.246581 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:55.247225 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:33:55.248813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1373/2767] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:33:54 2022] DELETE /identity/v3/projects/8741b1713bfc4c5e8147e7912d80635b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:34:04.748092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:05.243131 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:34.338813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828a40-97c5-49c7-9b1f-94b07489e0bb None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:34.339437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828a40-97c5-49c7-9b1f-94b07489e0bb None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:34.339437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828a40-97c5-49c7-9b1f-94b07489e0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:34.357590 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-d1828a40-97c5-49c7-9b1f-94b07489e0bb None None] MFA Rules not processed for user `a3db71a87efc459b8617e9632fcd59e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:34.358818 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d1828a40-97c5-49c7-9b1f-94b07489e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:34.415077 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1395/2768] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:34:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:44.408401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=25 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:26.585733 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:26.587806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:26.680326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a93863-797b-4b6b-8373-e6a84d8e17a6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:26.686772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd10a19-f4a4-4663-97d1-76f69fe24c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:26.688001 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd10a19-f4a4-4663-97d1-76f69fe24c4e service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:26.688479 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd10a19-f4a4-4663-97d1-76f69fe24c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:26.688986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd10a19-f4a4-4663-97d1-76f69fe24c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:26.691718 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-edd10a19-f4a4-4663-97d1-76f69fe24c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:26.856252 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd10a19-f4a4-4663-97d1-76f69fe24c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:26.859007 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd10a19-f4a4-4663-97d1-76f69fe24c4e service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:26.901273 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1374/2769] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:35:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:35:28.154502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828a40-97c5-49c7-9b1f-94b07489e0bb None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:28.156403 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-d1828a40-97c5-49c7-9b1f-94b07489e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:28.172061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828a40-97c5-49c7-9b1f-94b07489e0bb None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:28.175747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbb9a6-67ce-4b5a-b6a3-bf617df2b352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:28.176459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb9a6-67ce-4b5a-b6a3-bf617df2b352 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:28.176745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb9a6-67ce-4b5a-b6a3-bf617df2b352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:28.177023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbb9a6-67ce-4b5a-b6a3-bf617df2b352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:28.179700 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-dfbbb9a6-67ce-4b5a-b6a3-bf617df2b352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:28.197502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbb9a6-67ce-4b5a-b6a3-bf617df2b352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:28.198970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbb9a6-67ce-4b5a-b6a3-bf617df2b352 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:28.216661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1396/2770] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:35:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:35:36.894851 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=63 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:38.206092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=6 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:42.849962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd10a19-f4a4-4663-97d1-76f69fe24c4e service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:42.859504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd10a19-f4a4-4663-97d1-76f69fe24c4e service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:42.863405 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2bb87-5231-4cb3-b05f-7c80c5ab25b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:42.864155 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2bb87-5231-4cb3-b05f-7c80c5ab25b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:42.864649 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2bb87-5231-4cb3-b05f-7c80c5ab25b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:42.864988 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2bb87-5231-4cb3-b05f-7c80c5ab25b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:42.866833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-47c2bb87-5231-4cb3-b05f-7c80c5ab25b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:42.935379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2bb87-5231-4cb3-b05f-7c80c5ab25b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:42.936774 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2bb87-5231-4cb3-b05f-7c80c5ab25b0 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:42.948586 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1375/2771] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:35:51.729800 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbb9a6-67ce-4b5a-b6a3-bf617df2b352 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:51.732739 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-dfbbb9a6-67ce-4b5a-b6a3-bf617df2b352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:51.749340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbb9a6-67ce-4b5a-b6a3-bf617df2b352 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:51.754627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:51.755146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:51.755440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:51.755715 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] PATH_INFO: `/v3/users/14bd9be0202b433cb1fa8be6afee8ee5` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:51.757040 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bd9be0202b433cb1fa8be6afee8ee5)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:51.759024 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:52.003177 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bd9be0202b433cb1fa8be6afee8ee5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:52.189545 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bd9be0202b433cb1fa8be6afee8ee5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:52.207321 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bd9be0202b433cb1fa8be6afee8ee5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:52.208649 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bd9be0202b433cb1fa8be6afee8ee5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:52.217765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bd9be0202b433cb1fa8be6afee8ee5'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:52.225921 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1397/2772] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:35:51 2022] DELETE /identity/v3/users/14bd9be0202b433cb1fa8be6afee8ee5 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:35:52.522049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2bb87-5231-4cb3-b05f-7c80c5ab25b0 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:52.534038 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2bb87-5231-4cb3-b05f-7c80c5ab25b0 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:52.650163 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:52.651051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:52.651350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:52.651632 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] PATH_INFO: `/v3/projects/05cc8cf8ca8a43a1bacdc454652cfde2` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:52.652996 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05cc8cf8ca8a43a1bacdc454652cfde2)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:52.654955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:52.867537 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05cc8cf8ca8a43a1bacdc454652cfde2', 'request_id': 'req-ac97b991-3046-453f-942f-ed377b13e7e6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:52.874802 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05cc8cf8ca8a43a1bacdc454652cfde2', 'request_id': 'req-ac97b991-3046-453f-942f-ed377b13e7e6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:52.967989 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05cc8cf8ca8a43a1bacdc454652cfde2', 'request_id': 'req-ac97b991-3046-453f-942f-ed377b13e7e6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:52.980653 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] The token cache is being invalidate because project 05cc8cf8ca8a43a1bacdc454652cfde2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:35:52.980964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:52.981760 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:52.983519 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1376/2773] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:35:52 2022] DELETE /identity/v3/projects/05cc8cf8ca8a43a1bacdc454652cfde2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:35:52.988087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:52.990301 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:53.004761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cabdb-dd8c-4805-a273-eae4f444f9c9 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:53.075250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:53.076220 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:53.076512 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:53.076802 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] PATH_INFO: `/v3/users/900c82f6465047c4bbcdd67f3fd5d40d` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:53.078258 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900c82f6465047c4bbcdd67f3fd5d40d)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:53.080635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:53.298970 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900c82f6465047c4bbcdd67f3fd5d40d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:53.391838 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900c82f6465047c4bbcdd67f3fd5d40d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:53.408206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900c82f6465047c4bbcdd67f3fd5d40d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:53.409022 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900c82f6465047c4bbcdd67f3fd5d40d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:53.412052 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:53.418620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-f7f7217f-c756-4cec-87d6-c482783068d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900c82f6465047c4bbcdd67f3fd5d40d'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:53.425197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1398/2774] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:35:52 2022] DELETE /identity/v3/users/900c82f6465047c4bbcdd67f3fd5d40d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:35:53.727268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:35:53.729814 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:35:53.751369 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97b991-3046-453f-942f-ed377b13e7e6 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:35:53.782789 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:35:53.824133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:35:53.824923 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:35:53.825207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:35:53.825483 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] PATH_INFO: `/v3/projects/c8963123cc144931a4b648dbcf9bb19f` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:35:53.826770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8963123cc144931a4b648dbcf9bb19f)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:35:53.828743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:35:53.969523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8963123cc144931a4b648dbcf9bb19f', 'request_id': 'req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:53.976686 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8963123cc144931a4b648dbcf9bb19f', 'request_id': 'req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:54.156965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8963123cc144931a4b648dbcf9bb19f', 'request_id': 'req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:54.168711 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] The token cache is being invalidate because project c8963123cc144931a4b648dbcf9bb19f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:35:54.168990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:54.169681 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:35:54.171260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1377/2775] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:35:53 2022] DELETE /identity/v3/projects/c8963123cc144931a4b648dbcf9bb19f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:03.852246 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:04.271345 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:23.587711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19a87d-3482-4b69-a643-59d2152ba8dc None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.588493 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19a87d-3482-4b69-a643-59d2152ba8dc None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.588778 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19a87d-3482-4b69-a643-59d2152ba8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.617595 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ef19a87d-3482-4b69-a643-59d2152ba8dc None None] MFA Rules not processed for user `a3db71a87efc459b8617e9632fcd59e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:23.619675 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ef19a87d-3482-4b69-a643-59d2152ba8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:23.692289 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1399/2776] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:36:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:24.592691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.594177 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:24.669540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eeb5a-3222-4fdb-8cc9-a58cfd25bcec admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.674741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7234285-2d66-47f3-9c03-2712cd90213d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.675579 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7234285-2d66-47f3-9c03-2712cd90213d service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.676426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7234285-2d66-47f3-9c03-2712cd90213d service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.676714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7234285-2d66-47f3-9c03-2712cd90213d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.678638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d7234285-2d66-47f3-9c03-2712cd90213d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:24.690726 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7234285-2d66-47f3-9c03-2712cd90213d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.692917 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7234285-2d66-47f3-9c03-2712cd90213d service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.703176 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1378/2777] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:28.120481 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19a87d-3482-4b69-a643-59d2152ba8dc None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.122272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ef19a87d-3482-4b69-a643-59d2152ba8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:28.202512 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19a87d-3482-4b69-a643-59d2152ba8dc None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.207569 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd61d4-99a7-4024-90d2-00ed5318f1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.208327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd61d4-99a7-4024-90d2-00ed5318f1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.208606 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd61d4-99a7-4024-90d2-00ed5318f1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.209059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd61d4-99a7-4024-90d2-00ed5318f1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.210957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c9bd61d4-99a7-4024-90d2-00ed5318f1d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:28.223065 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd61d4-99a7-4024-90d2-00ed5318f1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.224565 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd61d4-99a7-4024-90d2-00ed5318f1d9 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.236312 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1400/2778] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:34.698739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=32 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.492532 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7234285-2d66-47f3-9c03-2712cd90213d service placement] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.493972 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d7234285-2d66-47f3-9c03-2712cd90213d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:35.591732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7234285-2d66-47f3-9c03-2712cd90213d service placement] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.598409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8df2d-dc42-4b53-8038-357b3b607f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.600702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8df2d-dc42-4b53-8038-357b3b607f58 service nova] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.600702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8df2d-dc42-4b53-8038-357b3b607f58 service nova] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.600702 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8df2d-dc42-4b53-8038-357b3b607f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.602290 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f4c8df2d-dc42-4b53-8038-357b3b607f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:35.619029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8df2d-dc42-4b53-8038-357b3b607f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.620764 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8df2d-dc42-4b53-8038-357b3b607f58 service nova] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.635112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1379/2779] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:36:38.230744 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=51 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:45.628787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=34 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:55.150829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd61d4-99a7-4024-90d2-00ed5318f1d9 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:55.165765 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd61d4-99a7-4024-90d2-00ed5318f1d9 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:55.171317 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a43a-4444-420a-9b2b-4c6c78e54155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:55.172009 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a43a-4444-420a-9b2b-4c6c78e54155 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.172491 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a43a-4444-420a-9b2b-4c6c78e54155 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.172774 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a43a-4444-420a-9b2b-4c6c78e54155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.175098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-89a5a43a-4444-420a-9b2b-4c6c78e54155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:55.186684 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a43a-4444-420a-9b2b-4c6c78e54155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:55.188360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a43a-4444-420a-9b2b-4c6c78e54155 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.199625 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1401/2780] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:05.194307 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=6 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:16.732650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120cee4-a799-4c34-90c4-34b5389d4bd5 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:16.738952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120cee4-a799-4c34-90c4-34b5389d4bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:16.738952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120cee4-a799-4c34-90c4-34b5389d4bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:16.753011 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-5120cee4-a799-4c34-90c4-34b5389d4bd5 None None] MFA Rules not processed for user `a3db71a87efc459b8617e9632fcd59e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:16.754243 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5120cee4-a799-4c34-90c4-34b5389d4bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:16.761186 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1380/2781] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:38:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:17.066694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a43a-4444-420a-9b2b-4c6c78e54155 service nova] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:17.068140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-89a5a43a-4444-420a-9b2b-4c6c78e54155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:17.080530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a43a-4444-420a-9b2b-4c6c78e54155 service nova] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:17.084179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def2734-bd1f-44e9-8686-1c8f21f5a29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:17.084824 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2734-bd1f-44e9-8686-1c8f21f5a29d service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:17.085111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2734-bd1f-44e9-8686-1c8f21f5a29d service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:17.085390 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2734-bd1f-44e9-8686-1c8f21f5a29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:17.087149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7def2734-bd1f-44e9-8686-1c8f21f5a29d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:17.096994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def2734-bd1f-44e9-8686-1c8f21f5a29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:17.098439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def2734-bd1f-44e9-8686-1c8f21f5a29d service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:17.106571 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1402/2782] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:26.746991 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:27.102966 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=6 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:33.475995 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120cee4-a799-4c34-90c4-34b5389d4bd5 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:33.479368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-5120cee4-a799-4c34-90c4-34b5389d4bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:33.511015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120cee4-a799-4c34-90c4-34b5389d4bd5 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:33.518606 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0801f-21f4-48af-9b1c-5958fead844b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:33.519526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0801f-21f4-48af-9b1c-5958fead844b service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:33.519823 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0801f-21f4-48af-9b1c-5958fead844b service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:33.520120 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0801f-21f4-48af-9b1c-5958fead844b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:33.525818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-c6e0801f-21f4-48af-9b1c-5958fead844b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:33.538707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0801f-21f4-48af-9b1c-5958fead844b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:33.540403 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0801f-21f4-48af-9b1c-5958fead844b service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:33.562542 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1381/2783] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:43.547573 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=6 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:05.198599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def2734-bd1f-44e9-8686-1c8f21f5a29d service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:05.198599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def2734-bd1f-44e9-8686-1c8f21f5a29d service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:05.198599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4197d04-ff0a-4f98-9a10-5b789e3c2f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae1c6084061f4434864e9f7bcc553733', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:05.198599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197d04-ff0a-4f98-9a10-5b789e3c2f63 service nova] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:05.202689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197d04-ff0a-4f98-9a10-5b789e3c2f63 service nova] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:05.202689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197d04-ff0a-4f98-9a10-5b789e3c2f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:05.202689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c4197d04-ff0a-4f98-9a10-5b789e3c2f63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:05.202689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4197d04-ff0a-4f98-9a10-5b789e3c2f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:05.202689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4197d04-ff0a-4f98-9a10-5b789e3c2f63 service nova] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:05.202689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1403/2784] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:40:12.074797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0801f-21f4-48af-9b1c-5958fead844b service placement] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:12.084794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0801f-21f4-48af-9b1c-5958fead844b service placement] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:12.088381 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b69293-f10c-4449-973d-5b7968c8b76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:12.089023 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b69293-f10c-4449-973d-5b7968c8b76a service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:12.089312 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b69293-f10c-4449-973d-5b7968c8b76a service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:12.089614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b69293-f10c-4449-973d-5b7968c8b76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:12.091418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-56b69293-f10c-4449-973d-5b7968c8b76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:12.154959 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b69293-f10c-4449-973d-5b7968c8b76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:12.156438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b69293-f10c-4449-973d-5b7968c8b76a service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:12.166505 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1382/2785] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:15.146074 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=6 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:15.827948 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4197d04-ff0a-4f98-9a10-5b789e3c2f63 service nova] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:15.839586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4197d04-ff0a-4f98-9a10-5b789e3c2f63 service nova] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:15.845411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f703-5b10-4e85-9914-bb47d96d2c1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:15.846072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f703-5b10-4e85-9914-bb47d96d2c1f service placement] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:15.846352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f703-5b10-4e85-9914-bb47d96d2c1f service placement] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:15.846629 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f703-5b10-4e85-9914-bb47d96d2c1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:15.848441 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b156f703-5b10-4e85-9914-bb47d96d2c1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:15.861322 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156f703-5b10-4e85-9914-bb47d96d2c1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:15.862923 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156f703-5b10-4e85-9914-bb47d96d2c1f service placement] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:15.873222 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1404/2786] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:15.973357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b69293-f10c-4449-973d-5b7968c8b76a service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:15.974893 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-56b69293-f10c-4449-973d-5b7968c8b76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:15.988948 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b69293-f10c-4449-973d-5b7968c8b76a service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:15.993643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:15.994523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:15.994800 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:15.995075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] PATH_INFO: `/v3/users/a3db71a87efc459b8617e9632fcd59e6` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:15.996307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3db71a87efc459b8617e9632fcd59e6)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:15.998341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:16.233339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3db71a87efc459b8617e9632fcd59e6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.336379 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3db71a87efc459b8617e9632fcd59e6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.349459 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3db71a87efc459b8617e9632fcd59e6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.350139 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3db71a87efc459b8617e9632fcd59e6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.361870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-eef66a39-c2cf-4a8b-bf7a-dbf7e2bfcca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3db71a87efc459b8617e9632fcd59e6'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.367705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1383/2787] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:15 2022] DELETE /identity/v3/users/a3db71a87efc459b8617e9632fcd59e6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:16.635559 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f703-5b10-4e85-9914-bb47d96d2c1f service placement] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:16.647197 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f703-5b10-4e85-9914-bb47d96d2c1f service placement] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:16.703734 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:16.704638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:16.704925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:16.705205 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] PATH_INFO: `/v3/projects/7e67e4d57a904f8eb14d2e8b8100cef1` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:16.706380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e67e4d57a904f8eb14d2e8b8100cef1)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:16.708333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:16.830592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e67e4d57a904f8eb14d2e8b8100cef1', 'request_id': 'req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.837234 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e67e4d57a904f8eb14d2e8b8100cef1', 'request_id': 'req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.925206 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e67e4d57a904f8eb14d2e8b8100cef1', 'request_id': 'req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.936635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] The token cache is being invalidate because project 7e67e4d57a904f8eb14d2e8b8100cef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:16.936920 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.937544 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-ab9144f7-8dd5-4805-bf76-75648a2e6e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:16.939072 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1405/2788] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:16 2022] DELETE /identity/v3/projects/7e67e4d57a904f8eb14d2e8b8100cef1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:16.944123 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe69dd-e3ff-4ad2-980c-9c2be74e9e0b None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:16.944415 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe69dd-e3ff-4ad2-980c-9c2be74e9e0b None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:16.944697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe69dd-e3ff-4ad2-980c-9c2be74e9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:16.962233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-b7fe69dd-e3ff-4ad2-980c-9c2be74e9e0b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:16.963416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-b7fe69dd-e3ff-4ad2-980c-9c2be74e9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:17.020771 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1384/2789] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:17.029151 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d0c31-1ad2-4f81-88dd-d9ce493790aa None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.029501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d0c31-1ad2-4f81-88dd-d9ce493790aa None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.029925 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d0c31-1ad2-4f81-88dd-d9ce493790aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.048611 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-399d0c31-1ad2-4f81-88dd-d9ce493790aa None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:17.049806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-399d0c31-1ad2-4f81-88dd-d9ce493790aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:17.058287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1406/2790] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:17.063025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe69dd-e3ff-4ad2-980c-9c2be74e9e0b None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:17.073730 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe69dd-e3ff-4ad2-980c-9c2be74e9e0b None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:17.079224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fabb2d-cdf2-4175-a0b6-f0c34a4e9a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:17.079915 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fabb2d-cdf2-4175-a0b6-f0c34a4e9a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.080207 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fabb2d-cdf2-4175-a0b6-f0c34a4e9a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.080511 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fabb2d-cdf2-4175-a0b6-f0c34a4e9a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.081216 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fabb2d-cdf2-4175-a0b6-f0c34a4e9a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:17.081551 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fabb2d-cdf2-4175-a0b6-f0c34a4e9a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:17.083158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fabb2d-cdf2-4175-a0b6-f0c34a4e9a70 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:17.084784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:17.095298 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1385/2791] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:17.103594 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d0c31-1ad2-4f81-88dd-d9ce493790aa None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:17.113456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d0c31-1ad2-4f81-88dd-d9ce493790aa None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:17.118138 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89459119-370d-459e-87c7-405606261688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:17.118817 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89459119-370d-459e-87c7-405606261688 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.119101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89459119-370d-459e-87c7-405606261688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.119379 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89459119-370d-459e-87c7-405606261688 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.120112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89459119-370d-459e-87c7-405606261688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:17.122033 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89459119-370d-459e-87c7-405606261688 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:17.262342 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1407/2792] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:17 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:17.266575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fabb2d-cdf2-4175-a0b6-f0c34a4e9a70 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:17.276356 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fabb2d-cdf2-4175-a0b6-f0c34a4e9a70 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:17.333578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55246f05-ed41-4840-a167-9b06b6f69f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:17.334526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246f05-ed41-4840-a167-9b06b6f69f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.334526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246f05-ed41-4840-a167-9b06b6f69f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.334796 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246f05-ed41-4840-a167-9b06b6f69f14 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.335700 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55246f05-ed41-4840-a167-9b06b6f69f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:17.337629 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55246f05-ed41-4840-a167-9b06b6f69f14 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:17.507027 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1386/2793] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:17 2022] POST /identity/v3/users => generated 283 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:17.511437 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89459119-370d-459e-87c7-405606261688 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:17.522209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89459119-370d-459e-87c7-405606261688 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:17.526698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fac9af-546c-47c0-91be-dee46eedc8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:17.528227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fac9af-546c-47c0-91be-dee46eedc8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.528227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fac9af-546c-47c0-91be-dee46eedc8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.528227 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fac9af-546c-47c0-91be-dee46eedc8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.528644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fac9af-546c-47c0-91be-dee46eedc8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:17.530793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fac9af-546c-47c0-91be-dee46eedc8a7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:17.540573 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1408/2794] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:17.544939 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55246f05-ed41-4840-a167-9b06b6f69f14 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:17.558980 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55246f05-ed41-4840-a167-9b06b6f69f14 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:17.559499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bd184-bd22-4f23-b65f-277fd6611822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:17.560187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd184-bd22-4f23-b65f-277fd6611822 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.560474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd184-bd22-4f23-b65f-277fd6611822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.560752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bd184-bd22-4f23-b65f-277fd6611822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.561469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bd184-bd22-4f23-b65f-277fd6611822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:17.563064 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bd184-bd22-4f23-b65f-277fd6611822 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:17.573577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1387/2795] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:17.578406 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fac9af-546c-47c0-91be-dee46eedc8a7 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:17.590049 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fac9af-546c-47c0-91be-dee46eedc8a7 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:17.596488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14cf9-be57-4f0f-b2f7-e8454fd59fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:17.596488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14cf9-be57-4f0f-b2f7-e8454fd59fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.596760 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14cf9-be57-4f0f-b2f7-e8454fd59fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.596876 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de14cf9-be57-4f0f-b2f7-e8454fd59fb5 admin admin] PATH_INFO: `/v3/projects/1e56fe2b1e4f4ee8818308016f5fcba8/users/63aa0ded45ea4fb9a5d91fc22d50fc75/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.611240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de14cf9-be57-4f0f-b2f7-e8454fd59fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e56fe2b1e4f4ee8818308016f5fcba8, user_id=63aa0ded45ea4fb9a5d91fc22d50fc75, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:17.614007 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de14cf9-be57-4f0f-b2f7-e8454fd59fb5 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:17.748464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1409/2796] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:17 2022] PUT /identity/v3/projects/1e56fe2b1e4f4ee8818308016f5fcba8/users/63aa0ded45ea4fb9a5d91fc22d50fc75/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:17.759233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b7b6-da0c-4ab0-9244-6cd6aaad47b0 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.759523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b7b6-da0c-4ab0-9244-6cd6aaad47b0 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.759849 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b7b6-da0c-4ab0-9244-6cd6aaad47b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.788323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-6711b7b6-da0c-4ab0-9244-6cd6aaad47b0 None None] MFA Rules not processed for user `63aa0ded45ea4fb9a5d91fc22d50fc75`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:17.789525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6711b7b6-da0c-4ab0-9244-6cd6aaad47b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:17.853158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1388/2797] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:17.863812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14cf9-be57-4f0f-b2f7-e8454fd59fb5 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:17.865518 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-0de14cf9-be57-4f0f-b2f7-e8454fd59fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:17.871919 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:17.921886 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de14cf9-be57-4f0f-b2f7-e8454fd59fb5 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:17.925616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e692c7c-7edd-4b17-b399-e24bfde24aaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:17.931325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692c7c-7edd-4b17-b399-e24bfde24aaa service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:17.931325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692c7c-7edd-4b17-b399-e24bfde24aaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:17.931325 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692c7c-7edd-4b17-b399-e24bfde24aaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:17.934957 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e692c7c-7edd-4b17-b399-e24bfde24aaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:17.936933 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e692c7c-7edd-4b17-b399-e24bfde24aaa service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:17.950522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1410/2798] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:27.850229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:28.004989 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=24 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:28.236282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711b7b6-da0c-4ab0-9244-6cd6aaad47b0 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:28.297442 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711b7b6-da0c-4ab0-9244-6cd6aaad47b0 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:28.301976 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:28.302847 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:28.303128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:28.303426 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] PATH_INFO: `/v3/users/63aa0ded45ea4fb9a5d91fc22d50fc75` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:28.304634 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63aa0ded45ea4fb9a5d91fc22d50fc75)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:28.306575 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:28.514868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63aa0ded45ea4fb9a5d91fc22d50fc75'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:28.587667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63aa0ded45ea4fb9a5d91fc22d50fc75'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:28.600317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63aa0ded45ea4fb9a5d91fc22d50fc75'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:28.601012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63aa0ded45ea4fb9a5d91fc22d50fc75'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:28.607843 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63aa0ded45ea4fb9a5d91fc22d50fc75'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:28.613891 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1389/2799] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:28 2022] DELETE /identity/v3/users/63aa0ded45ea4fb9a5d91fc22d50fc75 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:28.619018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dade42c-ed6b-496f-8c6d-73d4821df989 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:28.619308 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dade42c-ed6b-496f-8c6d-73d4821df989 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:28.619588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dade42c-ed6b-496f-8c6d-73d4821df989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:28.636192 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-8dade42c-ed6b-496f-8c6d-73d4821df989 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:28.642618 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8dade42c-ed6b-496f-8c6d-73d4821df989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:28.695434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1411/2800] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:28.705866 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:28.707306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:28.764283 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b54789-2e5a-4b32-ab91-7b6285b97d66 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:28.768633 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e17f28-1f43-45bb-a479-9e9bd79ce2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:28.769220 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e17f28-1f43-45bb-a479-9e9bd79ce2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:28.769502 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e17f28-1f43-45bb-a479-9e9bd79ce2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:28.769787 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e17f28-1f43-45bb-a479-9e9bd79ce2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:28.779643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e17f28-1f43-45bb-a479-9e9bd79ce2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:28.781013 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e17f28-1f43-45bb-a479-9e9bd79ce2f9 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:28.791402 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1390/2801] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:29.274360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dade42c-ed6b-496f-8c6d-73d4821df989 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:29.275912 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-8dade42c-ed6b-496f-8c6d-73d4821df989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:29.290117 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dade42c-ed6b-496f-8c6d-73d4821df989 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:29.294958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:29.295841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:29.297004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:29.297581 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] PATH_INFO: `/v3/projects/1e56fe2b1e4f4ee8818308016f5fcba8` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:29.298841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e56fe2b1e4f4ee8818308016f5fcba8)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:29.300892 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:29.491113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e56fe2b1e4f4ee8818308016f5fcba8', 'request_id': 'req-31ceeaf0-755b-4f9b-a584-faad34c207e9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:29.497272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e56fe2b1e4f4ee8818308016f5fcba8', 'request_id': 'req-31ceeaf0-755b-4f9b-a584-faad34c207e9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:29.650620 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e56fe2b1e4f4ee8818308016f5fcba8', 'request_id': 'req-31ceeaf0-755b-4f9b-a584-faad34c207e9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:29.662486 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] The token cache is being invalidate because project 1e56fe2b1e4f4ee8818308016f5fcba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:29.662816 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:29.663439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-31ceeaf0-755b-4f9b-a584-faad34c207e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:29.664998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1412/2802] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:29 2022] DELETE /identity/v3/projects/1e56fe2b1e4f4ee8818308016f5fcba8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:29.670017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0ce3-9ee3-4f22-b709-87fed1ac7955 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:29.670499 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0ce3-9ee3-4f22-b709-87fed1ac7955 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:29.670618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0ce3-9ee3-4f22-b709-87fed1ac7955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:29.687756 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-938c0ce3-9ee3-4f22-b709-87fed1ac7955 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:29.688974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-938c0ce3-9ee3-4f22-b709-87fed1ac7955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:29.705765 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:29.746735 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1391/2803] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:29.754626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a98eb-caec-4b4f-96ae-f8d13f82c809 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:29.754941 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a98eb-caec-4b4f-96ae-f8d13f82c809 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:29.755252 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a98eb-caec-4b4f-96ae-f8d13f82c809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:29.773998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ef0a98eb-caec-4b4f-96ae-f8d13f82c809 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:29.777079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ef0a98eb-caec-4b4f-96ae-f8d13f82c809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:29.783843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1413/2804] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:29.788127 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c0ce3-9ee3-4f22-b709-87fed1ac7955 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:29.797722 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c0ce3-9ee3-4f22-b709-87fed1ac7955 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:29.802339 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aae98-3443-4a7c-9c14-fd96ec95efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:29.803004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aae98-3443-4a7c-9c14-fd96ec95efbe admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:29.803462 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aae98-3443-4a7c-9c14-fd96ec95efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:29.803755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aae98-3443-4a7c-9c14-fd96ec95efbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:29.804812 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aae98-3443-4a7c-9c14-fd96ec95efbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:29.805138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aae98-3443-4a7c-9c14-fd96ec95efbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:29.806818 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7aae98-3443-4a7c-9c14-fd96ec95efbe admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:29.819526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1392/2805] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:29.824277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a98eb-caec-4b4f-96ae-f8d13f82c809 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:29.834295 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a98eb-caec-4b4f-96ae-f8d13f82c809 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:29.839111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386430c-5edb-4b75-b4e6-47c3e30fe14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:29.839761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386430c-5edb-4b75-b4e6-47c3e30fe14d admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:29.840079 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386430c-5edb-4b75-b4e6-47c3e30fe14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:29.840360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386430c-5edb-4b75-b4e6-47c3e30fe14d admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:29.841041 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386430c-5edb-4b75-b4e6-47c3e30fe14d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:29.842943 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386430c-5edb-4b75-b4e6-47c3e30fe14d admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:29.937589 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1414/2806] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:29 2022] POST /identity/v3/projects => generated 405 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:29.942416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aae98-3443-4a7c-9c14-fd96ec95efbe admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:29.952533 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aae98-3443-4a7c-9c14-fd96ec95efbe admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.008037 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a694da7-fab7-4223-8ba3-460272d13b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.008707 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694da7-fab7-4223-8ba3-460272d13b97 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.008990 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694da7-fab7-4223-8ba3-460272d13b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.009266 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694da7-fab7-4223-8ba3-460272d13b97 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.009955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a694da7-fab7-4223-8ba3-460272d13b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.011899 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a694da7-fab7-4223-8ba3-460272d13b97 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.119556 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1393/2807] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:29 2022] POST /identity/v3/users => generated 303 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:30.124070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386430c-5edb-4b75-b4e6-47c3e30fe14d admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.135179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386430c-5edb-4b75-b4e6-47c3e30fe14d admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.140145 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dd32e-46f6-4c7c-a002-a926cb397538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.140859 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dd32e-46f6-4c7c-a002-a926cb397538 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.141162 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dd32e-46f6-4c7c-a002-a926cb397538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.141439 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dd32e-46f6-4c7c-a002-a926cb397538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.142761 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dd32e-46f6-4c7c-a002-a926cb397538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.144380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dd32e-46f6-4c7c-a002-a926cb397538 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.155743 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1415/2808] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:30.159859 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a694da7-fab7-4223-8ba3-460272d13b97 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.170180 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a694da7-fab7-4223-8ba3-460272d13b97 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.175309 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab526744-5408-4829-9944-39b56ad1c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.175999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526744-5408-4829-9944-39b56ad1c056 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.176289 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526744-5408-4829-9944-39b56ad1c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.176565 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab526744-5408-4829-9944-39b56ad1c056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.177281 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab526744-5408-4829-9944-39b56ad1c056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.178855 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab526744-5408-4829-9944-39b56ad1c056 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.188767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1394/2809] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:30.193348 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dd32e-46f6-4c7c-a002-a926cb397538 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.203850 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dd32e-46f6-4c7c-a002-a926cb397538 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.210000 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba28218-1b13-475c-9745-752c1898d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.210877 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba28218-1b13-475c-9745-752c1898d15b admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.211155 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba28218-1b13-475c-9745-752c1898d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.211426 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba28218-1b13-475c-9745-752c1898d15b admin admin] PATH_INFO: `/v3/projects/24ac0894d63d4c8eba1d120c31d3a9d5/users/27cef65a83304ea3a187134c3aa31aca/roles/b35814b03f814680843c3aead86264f7` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.226140 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba28218-1b13-475c-9745-752c1898d15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ac0894d63d4c8eba1d120c31d3a9d5, user_id=27cef65a83304ea3a187134c3aa31aca, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.228809 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba28218-1b13-475c-9745-752c1898d15b admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.308149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1416/2810] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:30 2022] PUT /identity/v3/projects/24ac0894d63d4c8eba1d120c31d3a9d5/users/27cef65a83304ea3a187134c3aa31aca/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:30.319136 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793c90-7bb8-4f45-a65a-1a555c929b04 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.319434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793c90-7bb8-4f45-a65a-1a555c929b04 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.319717 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793c90-7bb8-4f45-a65a-1a555c929b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.346300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0a793c90-7bb8-4f45-a65a-1a555c929b04 None None] MFA Rules not processed for user `27cef65a83304ea3a187134c3aa31aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:30.347523 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0a793c90-7bb8-4f45-a65a-1a555c929b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:30.410955 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1395/2811] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:30.415450 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba28218-1b13-475c-9745-752c1898d15b admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.436275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:30.475586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba28218-1b13-475c-9745-752c1898d15b admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.480271 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1ba8-3e13-41f9-89f0-06fb9b9f66b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.480926 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1ba8-3e13-41f9-89f0-06fb9b9f66b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.481210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1ba8-3e13-41f9-89f0-06fb9b9f66b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.481557 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1ba8-3e13-41f9-89f0-06fb9b9f66b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.482203 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1ba8-3e13-41f9-89f0-06fb9b9f66b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.484527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1ba8-3e13-41f9-89f0-06fb9b9f66b8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.594634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1417/2812] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:30 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:40:30.599179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a793c90-7bb8-4f45-a65a-1a555c929b04 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.610169 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a793c90-7bb8-4f45-a65a-1a555c929b04 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.622797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:30.666365 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795a6c3-ca3a-42eb-b432-e0a68d252923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.667015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795a6c3-ca3a-42eb-b432-e0a68d252923 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.667307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795a6c3-ca3a-42eb-b432-e0a68d252923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.667587 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795a6c3-ca3a-42eb-b432-e0a68d252923 admin admin] PATH_INFO: `/v3/users` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.668320 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795a6c3-ca3a-42eb-b432-e0a68d252923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.670237 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795a6c3-ca3a-42eb-b432-e0a68d252923 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.834271 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1396/2813] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:30 2022] POST /identity/v3/users => generated 309 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:30.838287 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1ba8-3e13-41f9-89f0-06fb9b9f66b8 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.849046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1ba8-3e13-41f9-89f0-06fb9b9f66b8 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.855759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308280e5-9360-4954-acd0-4a8f2820edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.855759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308280e5-9360-4954-acd0-4a8f2820edbc admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.855759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308280e5-9360-4954-acd0-4a8f2820edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.855759 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308280e5-9360-4954-acd0-4a8f2820edbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.856218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308280e5-9360-4954-acd0-4a8f2820edbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.857153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308280e5-9360-4954-acd0-4a8f2820edbc admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:30.868298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1418/2814] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:30.872464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795a6c3-ca3a-42eb-b432-e0a68d252923 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:30.882455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795a6c3-ca3a-42eb-b432-e0a68d252923 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:30.887084 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0528f6-c916-483c-8a71-be3456eb3ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:30.888008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0528f6-c916-483c-8a71-be3456eb3ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:30.888301 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0528f6-c916-483c-8a71-be3456eb3ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:30.888584 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0528f6-c916-483c-8a71-be3456eb3ae7 admin admin] PATH_INFO: `/v3/projects/e28af4e62449488f8763822290db0c0b/users/fc4195ce7cd94ecabed6e9945be44c10/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:30.903352 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0528f6-c916-483c-8a71-be3456eb3ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28af4e62449488f8763822290db0c0b, user_id=fc4195ce7cd94ecabed6e9945be44c10, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:30.906075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0528f6-c916-483c-8a71-be3456eb3ae7 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.028187 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1397/2815] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:30 2022] PUT /identity/v3/projects/e28af4e62449488f8763822290db0c0b/users/fc4195ce7cd94ecabed6e9945be44c10/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:31.032263 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308280e5-9360-4954-acd0-4a8f2820edbc admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.042946 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308280e5-9360-4954-acd0-4a8f2820edbc admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.098142 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fb846-6bad-4fdd-a905-ab890f8c1670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.098805 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb846-6bad-4fdd-a905-ab890f8c1670 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.099202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb846-6bad-4fdd-a905-ab890f8c1670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.099474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb846-6bad-4fdd-a905-ab890f8c1670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.100216 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fb846-6bad-4fdd-a905-ab890f8c1670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.101795 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fb846-6bad-4fdd-a905-ab890f8c1670 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.111276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1419/2816] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:31.115404 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0528f6-c916-483c-8a71-be3456eb3ae7 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.125704 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0528f6-c916-483c-8a71-be3456eb3ae7 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.130376 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b1a9d-5c4a-427d-90dd-ecd50c302466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.131260 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b1a9d-5c4a-427d-90dd-ecd50c302466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.131551 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b1a9d-5c4a-427d-90dd-ecd50c302466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.131837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b1a9d-5c4a-427d-90dd-ecd50c302466 admin admin] PATH_INFO: `/v3/projects/e28af4e62449488f8763822290db0c0b/users/fc4195ce7cd94ecabed6e9945be44c10/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.133853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b1a9d-5c4a-427d-90dd-ecd50c302466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28af4e62449488f8763822290db0c0b, user_id=fc4195ce7cd94ecabed6e9945be44c10, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.136528 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b1a9d-5c4a-427d-90dd-ecd50c302466 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.147456 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1398/2817] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:31 2022] PUT /identity/v3/projects/e28af4e62449488f8763822290db0c0b/users/fc4195ce7cd94ecabed6e9945be44c10/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:31.159593 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437a3f2-ed0c-43d4-826c-a3164a580d3f None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.160048 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437a3f2-ed0c-43d4-826c-a3164a580d3f None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.160401 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437a3f2-ed0c-43d4-826c-a3164a580d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.186209 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-9437a3f2-ed0c-43d4-826c-a3164a580d3f None None] MFA Rules not processed for user `fc4195ce7cd94ecabed6e9945be44c10`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:31.187413 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9437a3f2-ed0c-43d4-826c-a3164a580d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:31.262147 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1420/2818] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:31.273555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b1a9d-5c4a-427d-90dd-ecd50c302466 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.275234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-d68b1a9d-5c4a-427d-90dd-ecd50c302466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:31.332086 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b1a9d-5c4a-427d-90dd-ecd50c302466 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.335661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcdcfe-21e7-45e5-a640-a30246462a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.336333 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcdcfe-21e7-45e5-a640-a30246462a30 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.336621 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcdcfe-21e7-45e5-a640-a30246462a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.336902 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcdcfe-21e7-45e5-a640-a30246462a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.345813 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcdcfe-21e7-45e5-a640-a30246462a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.347244 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcdcfe-21e7-45e5-a640-a30246462a30 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.356469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1399/2819] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:31 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:40:31.494194 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437a3f2-ed0c-43d4-826c-a3164a580d3f None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:31.512104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:31.555150 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437a3f2-ed0c-43d4-826c-a3164a580d3f None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:31.559749 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:31.560681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:31.560962 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:31.561253 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] PATH_INFO: `/v3/users/27cef65a83304ea3a187134c3aa31aca` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:31.562527 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cef65a83304ea3a187134c3aa31aca)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:31.564533 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:31.951536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cef65a83304ea3a187134c3aa31aca'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.114200 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cef65a83304ea3a187134c3aa31aca'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.126644 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cef65a83304ea3a187134c3aa31aca'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.127973 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cef65a83304ea3a187134c3aa31aca'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.134062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cef65a83304ea3a187134c3aa31aca'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.139909 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1421/2820] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:31 2022] DELETE /identity/v3/users/27cef65a83304ea3a187134c3aa31aca => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:32.144639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1859b-5ca2-4994-9b0f-d6b92e4ab98e None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.145158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1859b-5ca2-4994-9b0f-d6b92e4ab98e None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.145267 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1859b-5ca2-4994-9b0f-d6b92e4ab98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.164238 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-0ab1859b-5ca2-4994-9b0f-d6b92e4ab98e None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:32.165439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0ab1859b-5ca2-4994-9b0f-d6b92e4ab98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.224178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1400/2821] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:32.233950 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:32.235455 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.291275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98336416-30c8-4ad8-ae6f-309ca15d9ebe admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:32.295164 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58e47-0bae-425f-9a92-afc6999d728d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:32.295801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58e47-0bae-425f-9a92-afc6999d728d service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.296111 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58e47-0bae-425f-9a92-afc6999d728d service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.296383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58e47-0bae-425f-9a92-afc6999d728d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.306199 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd58e47-0bae-425f-9a92-afc6999d728d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:32.307621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd58e47-0bae-425f-9a92-afc6999d728d service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:32.317054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1422/2822] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:32.798909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1859b-5ca2-4994-9b0f-d6b92e4ab98e None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:32.800510 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-0ab1859b-5ca2-4994-9b0f-d6b92e4ab98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:32.812705 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1859b-5ca2-4994-9b0f-d6b92e4ab98e None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:32.817930 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:32.818806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:32.819095 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:32.819378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] PATH_INFO: `/v3/projects/24ac0894d63d4c8eba1d120c31d3a9d5` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:32.820614 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ac0894d63d4c8eba1d120c31d3a9d5)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:32.822549 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:32.831134 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:32.986615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ac0894d63d4c8eba1d120c31d3a9d5', 'request_id': 'req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:32.992824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ac0894d63d4c8eba1d120c31d3a9d5', 'request_id': 'req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.130887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ac0894d63d4c8eba1d120c31d3a9d5', 'request_id': 'req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.142755 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] The token cache is being invalidate because project 24ac0894d63d4c8eba1d120c31d3a9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:33.143042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.143685 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.145292 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1401/2823] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:32 2022] DELETE /identity/v3/projects/24ac0894d63d4c8eba1d120c31d3a9d5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:33.149586 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58e47-0bae-425f-9a92-afc6999d728d service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:33.159250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58e47-0bae-425f-9a92-afc6999d728d service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:33.191442 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:33.213813 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:33.214681 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:33.214958 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:33.215229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] PATH_INFO: `/v3/users/fc4195ce7cd94ecabed6e9945be44c10` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:33.216444 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4195ce7cd94ecabed6e9945be44c10)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:33.218475 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:33.453588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4195ce7cd94ecabed6e9945be44c10'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.564793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4195ce7cd94ecabed6e9945be44c10'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.577440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4195ce7cd94ecabed6e9945be44c10'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.583828 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4195ce7cd94ecabed6e9945be44c10'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.584890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-5d5ed9ec-7f05-4a18-a755-c3c7e0b5cbf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4195ce7cd94ecabed6e9945be44c10'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:33.590771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1423/2824] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:33 2022] DELETE /identity/v3/users/fc4195ce7cd94ecabed6e9945be44c10 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:34.086688 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.098371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:34.101748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4e0f6-2469-4243-bc5c-628dbdbd8e67 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.159019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.159908 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.160193 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.160469 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] PATH_INFO: `/v3/projects/e28af4e62449488f8763822290db0c0b` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.161639 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28af4e62449488f8763822290db0c0b)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.163579 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.279593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28af4e62449488f8763822290db0c0b', 'request_id': 'req-d107efa0-6733-47c1-8a4c-d88f586f3382'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:34.286254 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28af4e62449488f8763822290db0c0b', 'request_id': 'req-d107efa0-6733-47c1-8a4c-d88f586f3382'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:34.353124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28af4e62449488f8763822290db0c0b', 'request_id': 'req-d107efa0-6733-47c1-8a4c-d88f586f3382'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:34.364496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] The token cache is being invalidate because project e28af4e62449488f8763822290db0c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:34.364786 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:34.365409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-d107efa0-6733-47c1-8a4c-d88f586f3382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:34.366944 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1402/2825] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:34 2022] DELETE /identity/v3/projects/e28af4e62449488f8763822290db0c0b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:34.371819 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f6757-5fd6-4feb-91ff-874989f5e099 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.372344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f6757-5fd6-4feb-91ff-874989f5e099 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.372459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f6757-5fd6-4feb-91ff-874989f5e099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.391783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-af8f6757-5fd6-4feb-91ff-874989f5e099 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:34.393092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-af8f6757-5fd6-4feb-91ff-874989f5e099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:34.452568 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1424/2826] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:34.460547 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d6086-187e-455a-adea-e5446bba99d7 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.460844 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d6086-187e-455a-adea-e5446bba99d7 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.461130 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d6086-187e-455a-adea-e5446bba99d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.479994 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-018d6086-187e-455a-adea-e5446bba99d7 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:34.481178 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-018d6086-187e-455a-adea-e5446bba99d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:34.489605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1403/2827] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:34.493920 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f6757-5fd6-4feb-91ff-874989f5e099 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.503299 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f6757-5fd6-4feb-91ff-874989f5e099 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.507771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13439-806b-4a81-bd90-835eeb12bc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.508451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13439-806b-4a81-bd90-835eeb12bc55 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.508733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13439-806b-4a81-bd90-835eeb12bc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.509006 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13439-806b-4a81-bd90-835eeb12bc55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.509726 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f13439-806b-4a81-bd90-835eeb12bc55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:34.510030 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f13439-806b-4a81-bd90-835eeb12bc55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.511634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f13439-806b-4a81-bd90-835eeb12bc55 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.523141 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1425/2828] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:34.527407 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d6086-187e-455a-adea-e5446bba99d7 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.537509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d6086-187e-455a-adea-e5446bba99d7 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.543646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bec0a-ce56-4cad-afee-01bd27b54e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.544413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bec0a-ce56-4cad-afee-01bd27b54e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.544807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bec0a-ce56-4cad-afee-01bd27b54e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.545190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bec0a-ce56-4cad-afee-01bd27b54e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.545982 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bec0a-ce56-4cad-afee-01bd27b54e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.548152 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bec0a-ce56-4cad-afee-01bd27b54e92 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.633491 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:34.640807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1404/2829] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:34 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:34.644858 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13439-806b-4a81-bd90-835eeb12bc55 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.655078 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13439-806b-4a81-bd90-835eeb12bc55 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.694776 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:34.709783 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fcf7c-118b-4b10-aaa8-7f7dcaeb8bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.710525 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fcf7c-118b-4b10-aaa8-7f7dcaeb8bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.710806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fcf7c-118b-4b10-aaa8-7f7dcaeb8bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.711081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fcf7c-118b-4b10-aaa8-7f7dcaeb8bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.711771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fcf7c-118b-4b10-aaa8-7f7dcaeb8bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.713689 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fcf7c-118b-4b10-aaa8-7f7dcaeb8bb4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.855456 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1426/2830] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:34 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:34.859598 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bec0a-ce56-4cad-afee-01bd27b54e92 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.869900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bec0a-ce56-4cad-afee-01bd27b54e92 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.874411 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1afb2f-42a3-4cc0-80f1-54662887d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.875067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1afb2f-42a3-4cc0-80f1-54662887d348 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.875364 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1afb2f-42a3-4cc0-80f1-54662887d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.875624 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1afb2f-42a3-4cc0-80f1-54662887d348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.876383 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1afb2f-42a3-4cc0-80f1-54662887d348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.878049 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1afb2f-42a3-4cc0-80f1-54662887d348 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.888613 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1405/2831] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:34.892701 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fcf7c-118b-4b10-aaa8-7f7dcaeb8bb4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.903352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fcf7c-118b-4b10-aaa8-7f7dcaeb8bb4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.908071 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c78f4-c4d2-41a3-9ce1-9e1f187784ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.908708 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c78f4-c4d2-41a3-9ce1-9e1f187784ac admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.908997 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c78f4-c4d2-41a3-9ce1-9e1f187784ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.909276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c78f4-c4d2-41a3-9ce1-9e1f187784ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.909998 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c78f4-c4d2-41a3-9ce1-9e1f187784ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.911592 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c78f4-c4d2-41a3-9ce1-9e1f187784ac admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:34.922657 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1427/2832] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:34.926897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1afb2f-42a3-4cc0-80f1-54662887d348 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:34.937409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1afb2f-42a3-4cc0-80f1-54662887d348 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:34.942255 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9745cc-e433-4bfe-b279-5fb076b591ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:34.942868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9745cc-e433-4bfe-b279-5fb076b591ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:34.943646 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9745cc-e433-4bfe-b279-5fb076b591ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:34.943958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9745cc-e433-4bfe-b279-5fb076b591ff admin admin] PATH_INFO: `/v3/projects/49ba9b80737646a589fc6cff9e65587d/users/8d5b4cfc0e024a2a8da2372ce809a673/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:34.958342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9745cc-e433-4bfe-b279-5fb076b591ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ba9b80737646a589fc6cff9e65587d, user_id=8d5b4cfc0e024a2a8da2372ce809a673, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:34.961615 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9745cc-e433-4bfe-b279-5fb076b591ff admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:35.079501 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1406/2833] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:34 2022] PUT /identity/v3/projects/49ba9b80737646a589fc6cff9e65587d/users/8d5b4cfc0e024a2a8da2372ce809a673/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:35.090605 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c25d7b-2886-4d26-b013-2a21c10455a8 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.090938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c25d7b-2886-4d26-b013-2a21c10455a8 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.091218 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c25d7b-2886-4d26-b013-2a21c10455a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.116630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-a6c25d7b-2886-4d26-b013-2a21c10455a8 None None] MFA Rules not processed for user `8d5b4cfc0e024a2a8da2372ce809a673`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:35.117831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-a6c25d7b-2886-4d26-b013-2a21c10455a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:35.181208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1428/2834] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:35.185608 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9745cc-e433-4bfe-b279-5fb076b591ff admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:35.258703 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9745cc-e433-4bfe-b279-5fb076b591ff admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:35.263435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee4b22-227d-4f24-aa4f-b699b07db960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:35.268004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee4b22-227d-4f24-aa4f-b699b07db960 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.268004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee4b22-227d-4f24-aa4f-b699b07db960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.268004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee4b22-227d-4f24-aa4f-b699b07db960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.268004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee4b22-227d-4f24-aa4f-b699b07db960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:35.268004 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee4b22-227d-4f24-aa4f-b699b07db960 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:35.383350 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1407/2835] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:35 2022] POST /identity/v3/projects => generated 391 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:35.387465 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c25d7b-2886-4d26-b013-2a21c10455a8 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:35.399344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c25d7b-2886-4d26-b013-2a21c10455a8 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:35.453753 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8bd7b-0622-48ef-8a8b-bb29ca74c682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:35.454352 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8bd7b-0622-48ef-8a8b-bb29ca74c682 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.454654 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8bd7b-0622-48ef-8a8b-bb29ca74c682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.454953 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8bd7b-0622-48ef-8a8b-bb29ca74c682 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.455635 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8bd7b-0622-48ef-8a8b-bb29ca74c682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:35.457598 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8bd7b-0622-48ef-8a8b-bb29ca74c682 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:35.588770 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1429/2836] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:35 2022] POST /identity/v3/users => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:40:35.592785 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee4b22-227d-4f24-aa4f-b699b07db960 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:35.603709 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee4b22-227d-4f24-aa4f-b699b07db960 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:35.608268 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6e5fd-1c21-43c7-a644-e4ad170cdc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:35.608961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6e5fd-1c21-43c7-a644-e4ad170cdc63 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.609378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6e5fd-1c21-43c7-a644-e4ad170cdc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.609663 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6e5fd-1c21-43c7-a644-e4ad170cdc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.610384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6e5fd-1c21-43c7-a644-e4ad170cdc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:35.612006 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6e5fd-1c21-43c7-a644-e4ad170cdc63 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:35.622324 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1408/2837] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:40:35.626340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8bd7b-0622-48ef-8a8b-bb29ca74c682 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:35.636528 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8bd7b-0622-48ef-8a8b-bb29ca74c682 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:35.641144 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135f9a4-5c61-4ccf-b98e-1550f5691927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:35.646044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135f9a4-5c61-4ccf-b98e-1550f5691927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.646044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135f9a4-5c61-4ccf-b98e-1550f5691927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.646044 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135f9a4-5c61-4ccf-b98e-1550f5691927 admin admin] PATH_INFO: `/v3/projects/a9554acd46194445a023af3516f11c5d/users/12eb9d60d4c840c7b85316594c4e9171/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.657542 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135f9a4-5c61-4ccf-b98e-1550f5691927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9554acd46194445a023af3516f11c5d, user_id=12eb9d60d4c840c7b85316594c4e9171, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:35.660380 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135f9a4-5c61-4ccf-b98e-1550f5691927 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:35.735992 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1430/2838] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:35 2022] PUT /identity/v3/projects/a9554acd46194445a023af3516f11c5d/users/12eb9d60d4c840c7b85316594c4e9171/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:35.739865 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6e5fd-1c21-43c7-a644-e4ad170cdc63 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:35.749897 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6e5fd-1c21-43c7-a644-e4ad170cdc63 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:35.806083 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331c8c1-030c-4806-a175-33df308792a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:35.806751 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c8c1-030c-4806-a175-33df308792a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.807032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c8c1-030c-4806-a175-33df308792a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.807306 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c8c1-030c-4806-a175-33df308792a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.808175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331c8c1-030c-4806-a175-33df308792a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:35.809868 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331c8c1-030c-4806-a175-33df308792a3 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:35.819910 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1409/2839] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:35.824338 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135f9a4-5c61-4ccf-b98e-1550f5691927 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:35.835319 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135f9a4-5c61-4ccf-b98e-1550f5691927 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:35.840081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e6519-e096-4fbf-a4c0-f8cdc36495a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:35.840888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6519-e096-4fbf-a4c0-f8cdc36495a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.851905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6519-e096-4fbf-a4c0-f8cdc36495a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.851905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e6519-e096-4fbf-a4c0-f8cdc36495a3 admin admin] PATH_INFO: `/v3/projects/a9554acd46194445a023af3516f11c5d/users/12eb9d60d4c840c7b85316594c4e9171/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.851905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e6519-e096-4fbf-a4c0-f8cdc36495a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9554acd46194445a023af3516f11c5d, user_id=12eb9d60d4c840c7b85316594c4e9171, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:35.851905 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e6519-e096-4fbf-a4c0-f8cdc36495a3 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:35.856488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1431/2840] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:35 2022] PUT /identity/v3/projects/a9554acd46194445a023af3516f11c5d/users/12eb9d60d4c840c7b85316594c4e9171/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:35.917809 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39da6d-b1f5-48d6-a854-531ad47bfa5f None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:35.918113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39da6d-b1f5-48d6-a854-531ad47bfa5f None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:35.918395 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39da6d-b1f5-48d6-a854-531ad47bfa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:35.945357 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-2b39da6d-b1f5-48d6-a854-531ad47bfa5f None None] MFA Rules not processed for user `12eb9d60d4c840c7b85316594c4e9171`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:35.949128 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2b39da6d-b1f5-48d6-a854-531ad47bfa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:35.967055 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:36.014531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1410/2841] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:36.025775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e6519-e096-4fbf-a4c0-f8cdc36495a3 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:36.029343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-cb3e6519-e096-4fbf-a4c0-f8cdc36495a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:36.033974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:36.084501 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e6519-e096-4fbf-a4c0-f8cdc36495a3 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:36.088135 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b69a5-8be7-4b75-af12-6b9799ea8540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:36.088773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b69a5-8be7-4b75-af12-6b9799ea8540 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:36.089057 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b69a5-8be7-4b75-af12-6b9799ea8540 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:36.089327 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b69a5-8be7-4b75-af12-6b9799ea8540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:36.098373 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b69a5-8be7-4b75-af12-6b9799ea8540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:36.099784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b69a5-8be7-4b75-af12-6b9799ea8540 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:36.108944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1432/2842] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:36.155334 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39da6d-b1f5-48d6-a854-531ad47bfa5f None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:36.156763 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2b39da6d-b1f5-48d6-a854-531ad47bfa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:36.168650 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39da6d-b1f5-48d6-a854-531ad47bfa5f None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:36.172747 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b0968-a132-4a5b-93c1-011cd29c7cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:36.173391 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b0968-a132-4a5b-93c1-011cd29c7cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:36.173674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b0968-a132-4a5b-93c1-011cd29c7cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:36.174048 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b0968-a132-4a5b-93c1-011cd29c7cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:36.231103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b0968-a132-4a5b-93c1-011cd29c7cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:36.232572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b0968-a132-4a5b-93c1-011cd29c7cb5 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:36.241877 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1411/2843] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:41.532910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b69a5-8be7-4b75-af12-6b9799ea8540 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:41.594410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b69a5-8be7-4b75-af12-6b9799ea8540 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:41.598916 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:41.599775 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:41.600132 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:41.600944 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] PATH_INFO: `/v3/users/8d5b4cfc0e024a2a8da2372ce809a673` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:41.602113 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5b4cfc0e024a2a8da2372ce809a673)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:41.604333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:41.847002 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5b4cfc0e024a2a8da2372ce809a673'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.962596 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5b4cfc0e024a2a8da2372ce809a673'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.975383 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5b4cfc0e024a2a8da2372ce809a673'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.976096 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5b4cfc0e024a2a8da2372ce809a673'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.983265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5b4cfc0e024a2a8da2372ce809a673'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:41.989316 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1433/2844] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:41 2022] DELETE /identity/v3/users/8d5b4cfc0e024a2a8da2372ce809a673 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:41.993962 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e683f7-6bf9-455f-b18e-d3c0c5a7ac47 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:41.994452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e683f7-6bf9-455f-b18e-d3c0c5a7ac47 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:41.994577 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e683f7-6bf9-455f-b18e-d3c0c5a7ac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.012054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-f6e683f7-6bf9-455f-b18e-d3c0c5a7ac47 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:42.013258 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f6e683f7-6bf9-455f-b18e-d3c0c5a7ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:42.072081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1412/2845] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:42.081882 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:42.083368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:42.114884 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:42.142733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef68bde-ffea-43a8-81fd-ed3b8f58e9e8 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:42.146371 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb8b36-7dcf-4e51-887f-3b631f621d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:42.147103 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb8b36-7dcf-4e51-887f-3b631f621d05 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:42.147367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb8b36-7dcf-4e51-887f-3b631f621d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:42.147634 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb8b36-7dcf-4e51-887f-3b631f621d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.157368 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb8b36-7dcf-4e51-887f-3b631f621d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:42.160952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb8b36-7dcf-4e51-887f-3b631f621d05 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:42.168750 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1434/2846] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:42.623082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e683f7-6bf9-455f-b18e-d3c0c5a7ac47 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:42.627977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-f6e683f7-6bf9-455f-b18e-d3c0c5a7ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:42.639474 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e683f7-6bf9-455f-b18e-d3c0c5a7ac47 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:42.644188 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:42.645077 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:42.645358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:42.645638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] PATH_INFO: `/v3/projects/49ba9b80737646a589fc6cff9e65587d` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.646831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ba9b80737646a589fc6cff9e65587d)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:42.649368 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:42.757612 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ba9b80737646a589fc6cff9e65587d', 'request_id': 'req-4f6a69b7-7523-45ba-b006-de62e3855955'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.759512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:42.764151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ba9b80737646a589fc6cff9e65587d', 'request_id': 'req-4f6a69b7-7523-45ba-b006-de62e3855955'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.859691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ba9b80737646a589fc6cff9e65587d', 'request_id': 'req-4f6a69b7-7523-45ba-b006-de62e3855955'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.870762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] The token cache is being invalidate because project 49ba9b80737646a589fc6cff9e65587d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:42.870987 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.871784 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:42.873385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1413/2847] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:42 2022] DELETE /identity/v3/projects/49ba9b80737646a589fc6cff9e65587d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:42.877627 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb8b36-7dcf-4e51-887f-3b631f621d05 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:42.887244 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb8b36-7dcf-4e51-887f-3b631f621d05 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:42.941910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:42.942815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:42.943068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:42.943343 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] PATH_INFO: `/v3/users/12eb9d60d4c840c7b85316594c4e9171` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:42.944602 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12eb9d60d4c840c7b85316594c4e9171)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:42.946536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:43.160952 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12eb9d60d4c840c7b85316594c4e9171'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.227476 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12eb9d60d4c840c7b85316594c4e9171'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.240319 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12eb9d60d4c840c7b85316594c4e9171'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.240967 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12eb9d60d4c840c7b85316594c4e9171'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.247745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-6c35e271-641d-4219-a05d-bff8107dadf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12eb9d60d4c840c7b85316594c4e9171'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.253782 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1435/2848] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:42 2022] DELETE /identity/v3/users/12eb9d60d4c840c7b85316594c4e9171 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:43.681153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:43.684203 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:43.698797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a69b7-7523-45ba-b006-de62e3855955 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:43.760555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:43.761448 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:43.761732 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:43.762008 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] PATH_INFO: `/v3/projects/a9554acd46194445a023af3516f11c5d` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:43.763259 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9554acd46194445a023af3516f11c5d)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:43.765175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:43.930033 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9554acd46194445a023af3516f11c5d', 'request_id': 'req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:43.936338 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9554acd46194445a023af3516f11c5d', 'request_id': 'req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:44.021856 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9554acd46194445a023af3516f11c5d', 'request_id': 'req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:44.033160 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] The token cache is being invalidate because project a9554acd46194445a023af3516f11c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:44.034067 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:44.034358 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-c4dc0820-b0ea-43e1-875e-4d2aa28f22f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:44.035819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1414/2849] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:43 2022] DELETE /identity/v3/projects/a9554acd46194445a023af3516f11c5d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:44.041546 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5242db1-1f8e-4199-94a9-def0cd5d3ba3 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.042085 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5242db1-1f8e-4199-94a9-def0cd5d3ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.042278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5242db1-1f8e-4199-94a9-def0cd5d3ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.063587 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-e5242db1-1f8e-4199-94a9-def0cd5d3ba3 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:44.068526 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e5242db1-1f8e-4199-94a9-def0cd5d3ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:44.109793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:44.125087 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1436/2850] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:44.133129 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97267232-501c-4aa2-84bd-745dc5bbfd90 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.133418 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97267232-501c-4aa2-84bd-745dc5bbfd90 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.133697 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97267232-501c-4aa2-84bd-745dc5bbfd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.151863 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-97267232-501c-4aa2-84bd-745dc5bbfd90 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:44.153071 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-97267232-501c-4aa2-84bd-745dc5bbfd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:44.160831 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1415/2851] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:44.165431 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5242db1-1f8e-4199-94a9-def0cd5d3ba3 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.175023 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5242db1-1f8e-4199-94a9-def0cd5d3ba3 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.180242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef17b4-48f1-473f-af3d-b26e2fcde355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.180910 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef17b4-48f1-473f-af3d-b26e2fcde355 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.181395 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef17b4-48f1-473f-af3d-b26e2fcde355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.181903 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef17b4-48f1-473f-af3d-b26e2fcde355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.183018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef17b4-48f1-473f-af3d-b26e2fcde355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:44.183381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef17b4-48f1-473f-af3d-b26e2fcde355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.185105 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef17b4-48f1-473f-af3d-b26e2fcde355 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.196853 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1437/2852] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:44.201326 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97267232-501c-4aa2-84bd-745dc5bbfd90 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.210616 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97267232-501c-4aa2-84bd-745dc5bbfd90 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.215546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fde8e-1728-4ab3-80fd-5ce53efda6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.216232 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fde8e-1728-4ab3-80fd-5ce53efda6bc admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.216513 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fde8e-1728-4ab3-80fd-5ce53efda6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.216794 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fde8e-1728-4ab3-80fd-5ce53efda6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.217487 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fde8e-1728-4ab3-80fd-5ce53efda6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.219439 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fde8e-1728-4ab3-80fd-5ce53efda6bc admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.371661 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1416/2853] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:44 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:44.375988 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef17b4-48f1-473f-af3d-b26e2fcde355 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.386062 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef17b4-48f1-473f-af3d-b26e2fcde355 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.441499 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09094e-fb9f-4317-9724-be9b4d5cdbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.442193 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09094e-fb9f-4317-9724-be9b4d5cdbbe admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.442474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09094e-fb9f-4317-9724-be9b4d5cdbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.442749 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09094e-fb9f-4317-9724-be9b4d5cdbbe admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.443445 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09094e-fb9f-4317-9724-be9b4d5cdbbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.445503 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09094e-fb9f-4317-9724-be9b4d5cdbbe admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.530195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1438/2854] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:44 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:44.534438 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fde8e-1728-4ab3-80fd-5ce53efda6bc admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.545799 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fde8e-1728-4ab3-80fd-5ce53efda6bc admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.550412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cf54b-933a-4f25-83a6-95310b74f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.551115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cf54b-933a-4f25-83a6-95310b74f102 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.551441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cf54b-933a-4f25-83a6-95310b74f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.551720 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cf54b-933a-4f25-83a6-95310b74f102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.552504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cf54b-933a-4f25-83a6-95310b74f102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.554179 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cf54b-933a-4f25-83a6-95310b74f102 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.564582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1417/2855] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:44.568768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09094e-fb9f-4317-9724-be9b4d5cdbbe admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.579083 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09094e-fb9f-4317-9724-be9b4d5cdbbe admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.583839 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3ac4e-63b0-4487-a4fd-149398903536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.585118 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3ac4e-63b0-4487-a4fd-149398903536 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.585407 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3ac4e-63b0-4487-a4fd-149398903536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.585690 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3ac4e-63b0-4487-a4fd-149398903536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.586416 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3ac4e-63b0-4487-a4fd-149398903536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.588060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3ac4e-63b0-4487-a4fd-149398903536 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.598160 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1439/2856] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:44.602916 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cf54b-933a-4f25-83a6-95310b74f102 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.614075 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cf54b-933a-4f25-83a6-95310b74f102 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.619853 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad3ffa-8534-4d6e-a5b8-1f6a8c0622cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.623618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3ffa-8534-4d6e-a5b8-1f6a8c0622cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.623618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3ffa-8534-4d6e-a5b8-1f6a8c0622cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.623618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3ffa-8534-4d6e-a5b8-1f6a8c0622cc admin admin] PATH_INFO: `/v3/projects/edf0d59034de4de79ab19ec371170379/users/c4cc29bf42ab43c1a8c47d9d04c8e712/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.636016 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad3ffa-8534-4d6e-a5b8-1f6a8c0622cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf0d59034de4de79ab19ec371170379, user_id=c4cc29bf42ab43c1a8c47d9d04c8e712, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.638657 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad3ffa-8534-4d6e-a5b8-1f6a8c0622cc admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:44.724560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1418/2857] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:44 2022] PUT /identity/v3/projects/edf0d59034de4de79ab19ec371170379/users/c4cc29bf42ab43c1a8c47d9d04c8e712/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:44.734811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff64c7-555c-4eb8-b19b-82f25314877d None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.735101 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff64c7-555c-4eb8-b19b-82f25314877d None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.735381 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff64c7-555c-4eb8-b19b-82f25314877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.762060 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-3dff64c7-555c-4eb8-b19b-82f25314877d None None] MFA Rules not processed for user `c4cc29bf42ab43c1a8c47d9d04c8e712`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:44.763260 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3dff64c7-555c-4eb8-b19b-82f25314877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:44.826119 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1440/2858] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:44.830560 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad3ffa-8534-4d6e-a5b8-1f6a8c0622cc admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:44.840032 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:44.891751 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad3ffa-8534-4d6e-a5b8-1f6a8c0622cc admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:44.896416 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f87ae-8301-4fcb-a14c-c62cedcbc47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:44.897103 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f87ae-8301-4fcb-a14c-c62cedcbc47a admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:44.897385 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f87ae-8301-4fcb-a14c-c62cedcbc47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:44.897662 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f87ae-8301-4fcb-a14c-c62cedcbc47a admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:44.898354 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f87ae-8301-4fcb-a14c-c62cedcbc47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:44.900922 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f87ae-8301-4fcb-a14c-c62cedcbc47a admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.051509 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1419/2859] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:44 2022] POST /identity/v3/projects => generated 367 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:45.056402 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff64c7-555c-4eb8-b19b-82f25314877d None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:45.067070 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff64c7-555c-4eb8-b19b-82f25314877d None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.111154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:45.126149 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e22a74-853f-417a-82b1-0a60a9a86e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.126895 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e22a74-853f-417a-82b1-0a60a9a86e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.127172 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e22a74-853f-417a-82b1-0a60a9a86e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.127474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e22a74-853f-417a-82b1-0a60a9a86e9a admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.128196 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e22a74-853f-417a-82b1-0a60a9a86e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.130098 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e22a74-853f-417a-82b1-0a60a9a86e9a admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.256440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1441/2860] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:45 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:45.261052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f87ae-8301-4fcb-a14c-c62cedcbc47a admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:45.271115 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f87ae-8301-4fcb-a14c-c62cedcbc47a admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.275682 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3786c-36ff-4d14-a676-4f4f9b7261d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.276389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3786c-36ff-4d14-a676-4f4f9b7261d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.276660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3786c-36ff-4d14-a676-4f4f9b7261d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.276940 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3786c-36ff-4d14-a676-4f4f9b7261d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.277659 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3786c-36ff-4d14-a676-4f4f9b7261d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.279255 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3786c-36ff-4d14-a676-4f4f9b7261d4 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.289671 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1420/2861] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:45.293756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e22a74-853f-417a-82b1-0a60a9a86e9a admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:45.303834 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e22a74-853f-417a-82b1-0a60a9a86e9a admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.309170 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebf0e8-1518-4432-b67f-8465a7fa9672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.310083 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebf0e8-1518-4432-b67f-8465a7fa9672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.310360 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebf0e8-1518-4432-b67f-8465a7fa9672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.310630 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebf0e8-1518-4432-b67f-8465a7fa9672 admin admin] PATH_INFO: `/v3/projects/2240927568364bd1bdfc7bf35be8ada2/users/0ae4d78c4f764521a36c25007274277a/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.326055 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebf0e8-1518-4432-b67f-8465a7fa9672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2240927568364bd1bdfc7bf35be8ada2, user_id=0ae4d78c4f764521a36c25007274277a, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.328711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebf0e8-1518-4432-b67f-8465a7fa9672 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.473806 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1442/2862] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:45 2022] PUT /identity/v3/projects/2240927568364bd1bdfc7bf35be8ada2/users/0ae4d78c4f764521a36c25007274277a/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:45.478335 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3786c-36ff-4d14-a676-4f4f9b7261d4 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:45.488282 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3786c-36ff-4d14-a676-4f4f9b7261d4 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.542974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3b850-8a6d-49df-890d-168c674fe722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.543555 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3b850-8a6d-49df-890d-168c674fe722 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.543840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3b850-8a6d-49df-890d-168c674fe722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.544149 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3b850-8a6d-49df-890d-168c674fe722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.544870 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3b850-8a6d-49df-890d-168c674fe722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.546458 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3b850-8a6d-49df-890d-168c674fe722 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.556869 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1421/2863] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:45.561068 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebf0e8-1518-4432-b67f-8465a7fa9672 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:45.571459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebf0e8-1518-4432-b67f-8465a7fa9672 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.576384 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1c509-743d-419b-aea2-12561f6854f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.577265 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1c509-743d-419b-aea2-12561f6854f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.577547 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1c509-743d-419b-aea2-12561f6854f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.577820 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1c509-743d-419b-aea2-12561f6854f7 admin admin] PATH_INFO: `/v3/projects/2240927568364bd1bdfc7bf35be8ada2/users/0ae4d78c4f764521a36c25007274277a/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.579754 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1c509-743d-419b-aea2-12561f6854f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2240927568364bd1bdfc7bf35be8ada2, user_id=0ae4d78c4f764521a36c25007274277a, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.582389 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1c509-743d-419b-aea2-12561f6854f7 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.592784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1443/2864] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:45 2022] PUT /identity/v3/projects/2240927568364bd1bdfc7bf35be8ada2/users/0ae4d78c4f764521a36c25007274277a/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:45.604541 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aec90-40cb-4823-ae7c-fb062170d879 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.604833 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aec90-40cb-4823-ae7c-fb062170d879 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.605114 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aec90-40cb-4823-ae7c-fb062170d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.632172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-087aec90-40cb-4823-ae7c-fb062170d879 None None] MFA Rules not processed for user `0ae4d78c4f764521a36c25007274277a`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:45.633401 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-087aec90-40cb-4823-ae7c-fb062170d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:45.700564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1422/2865] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:45.711745 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1c509-743d-419b-aea2-12561f6854f7 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:45.713523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-f3f1c509-743d-419b-aea2-12561f6854f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:45.770711 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1c509-743d-419b-aea2-12561f6854f7 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:45.774852 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094179e-b97d-49bb-8ce6-5d1ff795e7c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:45.775489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094179e-b97d-49bb-8ce6-5d1ff795e7c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:45.775773 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094179e-b97d-49bb-8ce6-5d1ff795e7c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:45.776081 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094179e-b97d-49bb-8ce6-5d1ff795e7c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:45.784938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094179e-b97d-49bb-8ce6-5d1ff795e7c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:45.786367 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094179e-b97d-49bb-8ce6-5d1ff795e7c4 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:45.796522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1444/2866] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:46.021817 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aec90-40cb-4823-ae7c-fb062170d879 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:46.027153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:46.032772 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aec90-40cb-4823-ae7c-fb062170d879 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:46.036316 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c9dae-6532-4419-90f3-813320ca8a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:46.037043 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c9dae-6532-4419-90f3-813320ca8a8b service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:46.037300 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c9dae-6532-4419-90f3-813320ca8a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:46.037578 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c9dae-6532-4419-90f3-813320ca8a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:46.093949 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c9dae-6532-4419-90f3-813320ca8a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:46.096950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c9dae-6532-4419-90f3-813320ca8a8b service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:46.104797 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1423/2867] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:53.229747 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094179e-b97d-49bb-8ce6-5d1ff795e7c4 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:53.292639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094179e-b97d-49bb-8ce6-5d1ff795e7c4 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:53.297865 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:53.298735 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:53.299018 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:53.299294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] PATH_INFO: `/v3/users/c4cc29bf42ab43c1a8c47d9d04c8e712` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:53.300873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4cc29bf42ab43c1a8c47d9d04c8e712)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:53.302856 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:53.522247 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:53.527208 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4cc29bf42ab43c1a8c47d9d04c8e712'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:53.604314 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4cc29bf42ab43c1a8c47d9d04c8e712'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:53.616722 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4cc29bf42ab43c1a8c47d9d04c8e712'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:53.617385 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4cc29bf42ab43c1a8c47d9d04c8e712'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:53.624063 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4cc29bf42ab43c1a8c47d9d04c8e712'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:53.629808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1445/2868] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:53 2022] DELETE /identity/v3/users/c4cc29bf42ab43c1a8c47d9d04c8e712 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:53.640057 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c074681-bc57-4f40-8c8e-7ae60da874c6 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:53.640628 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c074681-bc57-4f40-8c8e-7ae60da874c6 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:53.640767 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c074681-bc57-4f40-8c8e-7ae60da874c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:53.657743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-3c074681-bc57-4f40-8c8e-7ae60da874c6 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:53.658974 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3c074681-bc57-4f40-8c8e-7ae60da874c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:53.716146 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1424/2869] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:53.726236 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:53.727639 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:53.785936 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c746e-c5c0-4661-a7c3-188a0c7eb7a2 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:53.789638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718e2ae-6ea3-483d-8949-f100f8987017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:53.790276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718e2ae-6ea3-483d-8949-f100f8987017 service neutron] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:53.790583 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718e2ae-6ea3-483d-8949-f100f8987017 service neutron] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:53.790855 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718e2ae-6ea3-483d-8949-f100f8987017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:53.799784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718e2ae-6ea3-483d-8949-f100f8987017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:53.801294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718e2ae-6ea3-483d-8949-f100f8987017 service neutron] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:53.812757 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1446/2870] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:54.309016 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c074681-bc57-4f40-8c8e-7ae60da874c6 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:54.310464 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3c074681-bc57-4f40-8c8e-7ae60da874c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:54.323665 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c074681-bc57-4f40-8c8e-7ae60da874c6 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:54.328371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:54.329894 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:54.330182 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:54.330451 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] PATH_INFO: `/v3/projects/edf0d59034de4de79ab19ec371170379` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:54.331667 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf0d59034de4de79ab19ec371170379)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:54.333680 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:54.475051 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf0d59034de4de79ab19ec371170379', 'request_id': 'req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:54.481223 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf0d59034de4de79ab19ec371170379', 'request_id': 'req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:54.569574 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf0d59034de4de79ab19ec371170379', 'request_id': 'req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:54.580925 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] The token cache is being invalidate because project edf0d59034de4de79ab19ec371170379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:54.581212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:54.581903 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:54.583421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1425/2871] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:54 2022] DELETE /identity/v3/projects/edf0d59034de4de79ab19ec371170379 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:54.587530 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718e2ae-6ea3-483d-8949-f100f8987017 service neutron] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:54.597849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718e2ae-6ea3-483d-8949-f100f8987017 service neutron] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:54.652729 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:54.653597 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:54.653878 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:54.654182 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] PATH_INFO: `/v3/users/0ae4d78c4f764521a36c25007274277a` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:54.655358 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae4d78c4f764521a36c25007274277a)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:54.657811 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:54.840272 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae4d78c4f764521a36c25007274277a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:54.916275 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae4d78c4f764521a36c25007274277a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:54.924283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:54.929694 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae4d78c4f764521a36c25007274277a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:54.930363 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae4d78c4f764521a36c25007274277a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:54.937189 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-a52f9f40-1067-4d8e-832f-d662d3867e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae4d78c4f764521a36c25007274277a'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:54.943139 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1447/2872] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:54 2022] DELETE /identity/v3/users/0ae4d78c4f764521a36c25007274277a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:55.416003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:55.417468 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:55.430950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3db675-11b5-48f5-81a8-bf4ebbc5f231 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:55.453877 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:55.488618 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:55.489701 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:55.490212 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:55.490862 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] PATH_INFO: `/v3/projects/2240927568364bd1bdfc7bf35be8ada2` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:55.492201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2240927568364bd1bdfc7bf35be8ada2)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:55.494172 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:55.592497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2240927568364bd1bdfc7bf35be8ada2', 'request_id': 'req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:55.598890 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2240927568364bd1bdfc7bf35be8ada2', 'request_id': 'req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:55.649978 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2240927568364bd1bdfc7bf35be8ada2', 'request_id': 'req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:55.660666 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] The token cache is being invalidate because project 2240927568364bd1bdfc7bf35be8ada2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:55.660958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:55.661572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ae2a3acd-29a4-4de2-bff1-1e30f06433bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:55.663165 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1426/2873] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:55 2022] DELETE /identity/v3/projects/2240927568364bd1bdfc7bf35be8ada2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:55.668418 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7ef2-6491-42c0-9ead-276ff33b44f1 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:55.668904 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7ef2-6491-42c0-9ead-276ff33b44f1 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:55.669008 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7ef2-6491-42c0-9ead-276ff33b44f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:55.686232 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-7b1b7ef2-6491-42c0-9ead-276ff33b44f1 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:55.688100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-7b1b7ef2-6491-42c0-9ead-276ff33b44f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:55.752239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1448/2874] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:55.760435 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da635f0c-2299-42cc-ba81-50a0d8219469 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:55.760712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da635f0c-2299-42cc-ba81-50a0d8219469 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:55.761045 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da635f0c-2299-42cc-ba81-50a0d8219469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:55.779441 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-da635f0c-2299-42cc-ba81-50a0d8219469 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:55.780672 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-da635f0c-2299-42cc-ba81-50a0d8219469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:55.788754 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1427/2875] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:55.793733 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7ef2-6491-42c0-9ead-276ff33b44f1 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:55.807226 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7ef2-6491-42c0-9ead-276ff33b44f1 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:55.813612 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb98a2-e1f5-4d20-95a3-30b95662cddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:55.827429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb98a2-e1f5-4d20-95a3-30b95662cddc admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:55.827429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb98a2-e1f5-4d20-95a3-30b95662cddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:55.827429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb98a2-e1f5-4d20-95a3-30b95662cddc admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:55.827429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb98a2-e1f5-4d20-95a3-30b95662cddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:40:55.827429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb98a2-e1f5-4d20-95a3-30b95662cddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:55.827429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb98a2-e1f5-4d20-95a3-30b95662cddc admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:55.830793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1449/2876] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:40:55.835340 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da635f0c-2299-42cc-ba81-50a0d8219469 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:55.844605 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da635f0c-2299-42cc-ba81-50a0d8219469 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:55.849522 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db69ec-bada-4c9a-9beb-c5677f611d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:55.850253 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db69ec-bada-4c9a-9beb-c5677f611d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:55.850538 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db69ec-bada-4c9a-9beb-c5677f611d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:55.850819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db69ec-bada-4c9a-9beb-c5677f611d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:55.851517 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db69ec-bada-4c9a-9beb-c5677f611d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:55.853457 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db69ec-bada-4c9a-9beb-c5677f611d44 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:56.011840 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1428/2877] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:55 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:40:56.015663 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb98a2-e1f5-4d20-95a3-30b95662cddc admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:56.025685 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb98a2-e1f5-4d20-95a3-30b95662cddc admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:56.081535 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b6a2b-b9c0-4445-82d4-fe9dc91ce747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:56.082235 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b6a2b-b9c0-4445-82d4-fe9dc91ce747 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:56.082522 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b6a2b-b9c0-4445-82d4-fe9dc91ce747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:56.082801 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b6a2b-b9c0-4445-82d4-fe9dc91ce747 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:56.083497 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b6a2b-b9c0-4445-82d4-fe9dc91ce747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:56.085451 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b6a2b-b9c0-4445-82d4-fe9dc91ce747 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:56.176531 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1450/2878] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:56 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:56.180788 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db69ec-bada-4c9a-9beb-c5677f611d44 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:56.190998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db69ec-bada-4c9a-9beb-c5677f611d44 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:56.195546 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f153-ca4a-4c1e-933e-a9013c0fab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:56.196234 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f153-ca4a-4c1e-933e-a9013c0fab77 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:56.196516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f153-ca4a-4c1e-933e-a9013c0fab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:56.196793 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f153-ca4a-4c1e-933e-a9013c0fab77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:56.197554 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601f153-ca4a-4c1e-933e-a9013c0fab77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:56.199400 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601f153-ca4a-4c1e-933e-a9013c0fab77 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:56.209920 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1429/2879] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:56.214268 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b6a2b-b9c0-4445-82d4-fe9dc91ce747 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:56.225109 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b6a2b-b9c0-4445-82d4-fe9dc91ce747 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:56.229638 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae332bb9-eb52-48fd-abed-0d3d0a001655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:56.230298 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332bb9-eb52-48fd-abed-0d3d0a001655 admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:56.230578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332bb9-eb52-48fd-abed-0d3d0a001655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:56.230849 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332bb9-eb52-48fd-abed-0d3d0a001655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:56.231563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae332bb9-eb52-48fd-abed-0d3d0a001655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:56.233255 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae332bb9-eb52-48fd-abed-0d3d0a001655 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:56.243680 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1451/2880] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:56.247998 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f153-ca4a-4c1e-933e-a9013c0fab77 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:56.258118 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f153-ca4a-4c1e-933e-a9013c0fab77 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:56.262887 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da71a4-ce42-4974-ab08-a94b5b5c7b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:56.263719 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da71a4-ce42-4974-ab08-a94b5b5c7b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:56.264025 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da71a4-ce42-4974-ab08-a94b5b5c7b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:56.264325 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da71a4-ce42-4974-ab08-a94b5b5c7b72 admin admin] PATH_INFO: `/v3/projects/9b761cebe8334092a4ffa6e9549555c9/users/d087aec7192e4c64aac116a03519d6b9/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:56.278434 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da71a4-ce42-4974-ab08-a94b5b5c7b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b761cebe8334092a4ffa6e9549555c9, user_id=d087aec7192e4c64aac116a03519d6b9, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:56.281731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da71a4-ce42-4974-ab08-a94b5b5c7b72 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:56.369779 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1430/2881] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:56 2022] PUT /identity/v3/projects/9b761cebe8334092a4ffa6e9549555c9/users/d087aec7192e4c64aac116a03519d6b9/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:40:56.374831 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61dbf-922a-48c6-ab35-480830aad97b None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:56.375124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61dbf-922a-48c6-ab35-480830aad97b None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:56.375483 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61dbf-922a-48c6-ab35-480830aad97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:56.393215 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-ded61dbf-922a-48c6-ab35-480830aad97b None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:56.394415 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-ded61dbf-922a-48c6-ab35-480830aad97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:56.436333 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:56.453643 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1452/2882] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:56.463036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da71a4-ce42-4974-ab08-a94b5b5c7b72 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:56.464824 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-95da71a4-ce42-4974-ab08-a94b5b5c7b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:56.521321 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da71a4-ce42-4974-ab08-a94b5b5c7b72 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:56.524945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9a82b-a64e-4317-8362-aac193ba0d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:56.525593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a82b-a64e-4317-8362-aac193ba0d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:56.525879 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a82b-a64e-4317-8362-aac193ba0d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:56.526159 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a82b-a64e-4317-8362-aac193ba0d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:56.532744 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:56.536307 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9a82b-a64e-4317-8362-aac193ba0d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:56.537743 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9a82b-a64e-4317-8362-aac193ba0d6c service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:56.547054 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1431/2883] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:57.868390 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eb033-e24c-475c-ad21-caae5bf00597 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:57.868940 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eb033-e24c-475c-ad21-caae5bf00597 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:57.869046 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eb033-e24c-475c-ad21-caae5bf00597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:57.900297 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-288eb033-e24c-475c-ad21-caae5bf00597 None None] MFA Rules not processed for user `d087aec7192e4c64aac116a03519d6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:57.901536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-288eb033-e24c-475c-ad21-caae5bf00597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:57.969484 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1453/2884] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:57.974029 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9a82b-a64e-4317-8362-aac193ba0d6c service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:57.984638 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9a82b-a64e-4317-8362-aac193ba0d6c service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:57.989219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ca634-57a6-4d3c-bd94-9aa45fb34a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:57.989872 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ca634-57a6-4d3c-bd94-9aa45fb34a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:57.990192 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ca634-57a6-4d3c-bd94-9aa45fb34a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:57.990472 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ca634-57a6-4d3c-bd94-9aa45fb34a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:57.991158 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ca634-57a6-4d3c-bd94-9aa45fb34a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:57.993082 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ca634-57a6-4d3c-bd94-9aa45fb34a25 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.085353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1432/2885] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:40:57 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:58.089469 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288eb033-e24c-475c-ad21-caae5bf00597 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:58.100107 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288eb033-e24c-475c-ad21-caae5bf00597 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.155013 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de2258-f084-4c61-94cb-98828d77e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.155717 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2258-f084-4c61-94cb-98828d77e430 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.156092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2258-f084-4c61-94cb-98828d77e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.156370 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2258-f084-4c61-94cb-98828d77e430 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.157050 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de2258-f084-4c61-94cb-98828d77e430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.158977 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de2258-f084-4c61-94cb-98828d77e430 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.254473 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1454/2886] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:40:58 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:40:58.258452 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ca634-57a6-4d3c-bd94-9aa45fb34a25 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:58.269201 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ca634-57a6-4d3c-bd94-9aa45fb34a25 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.281582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ee9a9-156f-41b2-9e7d-42a7c72c686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.281582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ee9a9-156f-41b2-9e7d-42a7c72c686e admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.281582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ee9a9-156f-41b2-9e7d-42a7c72c686e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.281582 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ee9a9-156f-41b2-9e7d-42a7c72c686e admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.281986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ee9a9-156f-41b2-9e7d-42a7c72c686e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.281986 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ee9a9-156f-41b2-9e7d-42a7c72c686e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.288762 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1433/2887] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:58.292882 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de2258-f084-4c61-94cb-98828d77e430 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:58.303004 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de2258-f084-4c61-94cb-98828d77e430 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.307695 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980a452-999f-459a-8e3f-7515435e1062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.308609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980a452-999f-459a-8e3f-7515435e1062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.308900 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980a452-999f-459a-8e3f-7515435e1062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.309175 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980a452-999f-459a-8e3f-7515435e1062 admin admin] PATH_INFO: `/v3/projects/a43462f339504a52920db1d6ee190b92/users/6ea3beae629541698846713966404da1/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.324985 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980a452-999f-459a-8e3f-7515435e1062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43462f339504a52920db1d6ee190b92, user_id=6ea3beae629541698846713966404da1, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.327661 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980a452-999f-459a-8e3f-7515435e1062 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.403104 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1455/2888] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:58 2022] PUT /identity/v3/projects/a43462f339504a52920db1d6ee190b92/users/6ea3beae629541698846713966404da1/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:58.407492 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ee9a9-156f-41b2-9e7d-42a7c72c686e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:58.418527 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ee9a9-156f-41b2-9e7d-42a7c72c686e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.474977 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b77bf-2d1b-4270-80c9-800018652dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.475640 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b77bf-2d1b-4270-80c9-800018652dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.475952 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b77bf-2d1b-4270-80c9-800018652dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.476224 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b77bf-2d1b-4270-80c9-800018652dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.476997 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b77bf-2d1b-4270-80c9-800018652dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.478583 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b77bf-2d1b-4270-80c9-800018652dfe admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.488185 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1434/2889] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:40:58.492536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980a452-999f-459a-8e3f-7515435e1062 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:58.503247 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980a452-999f-459a-8e3f-7515435e1062 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:58.507938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f33b0b-c3d3-4207-965f-a130f222623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:58.508766 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33b0b-c3d3-4207-965f-a130f222623f admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:58.509047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33b0b-c3d3-4207-965f-a130f222623f admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:58.509326 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f33b0b-c3d3-4207-965f-a130f222623f admin admin] PATH_INFO: `/v3/projects/a43462f339504a52920db1d6ee190b92/users/6ea3beae629541698846713966404da1/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:58.511341 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f33b0b-c3d3-4207-965f-a130f222623f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43462f339504a52920db1d6ee190b92, user_id=6ea3beae629541698846713966404da1, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:58.514035 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f33b0b-c3d3-4207-965f-a130f222623f admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:58.524670 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1456/2890] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:40:58 2022] PUT /identity/v3/projects/a43462f339504a52920db1d6ee190b92/users/6ea3beae629541698846713966404da1/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:59.988239 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f3c67-e368-4b01-b90b-60ea9bba170d None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:59.988788 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f3c67-e368-4b01-b90b-60ea9bba170d None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:59.989173 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f3c67-e368-4b01-b90b-60ea9bba170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.019150 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-072f3c67-e368-4b01-b90b-60ea9bba170d None None] MFA Rules not processed for user `6ea3beae629541698846713966404da1`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:00.020419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-072f3c67-e368-4b01-b90b-60ea9bba170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:00.087674 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1435/2891] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:40:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:00.099214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f33b0b-c3d3-4207-965f-a130f222623f admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:00.101031 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-c8f33b0b-c3d3-4207-965f-a130f222623f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:00.134424 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:00.162411 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f33b0b-c3d3-4207-965f-a130f222623f admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:00.165974 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12fbed-e09e-49da-80ad-c2a058182472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:00.166613 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12fbed-e09e-49da-80ad-c2a058182472 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:00.166890 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12fbed-e09e-49da-80ad-c2a058182472 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:00.167157 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12fbed-e09e-49da-80ad-c2a058182472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:00.223471 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12fbed-e09e-49da-80ad-c2a058182472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:00.224848 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12fbed-e09e-49da-80ad-c2a058182472 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:00.234242 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1457/2892] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:02.054111 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f3c67-e368-4b01-b90b-60ea9bba170d None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:02.055564 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-072f3c67-e368-4b01-b90b-60ea9bba170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:02.068200 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f3c67-e368-4b01-b90b-60ea9bba170d None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:02.071807 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d47818-4c95-48e4-b99e-a12ddea28962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:02.072477 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d47818-4c95-48e4-b99e-a12ddea28962 service cinder] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:02.073030 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d47818-4c95-48e4-b99e-a12ddea28962 service cinder] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:02.073341 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d47818-4c95-48e4-b99e-a12ddea28962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:02.082906 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d47818-4c95-48e4-b99e-a12ddea28962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:02.084371 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d47818-4c95-48e4-b99e-a12ddea28962 service cinder] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:02.105113 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1436/2893] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:10.272474 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=35 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:12.089342 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:19.651814 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12fbed-e09e-49da-80ad-c2a058182472 service cinder] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:19.714599 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12fbed-e09e-49da-80ad-c2a058182472 service cinder] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:19.719434 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:19.722827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:19.722827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:19.722827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] PATH_INFO: `/v3/users/d087aec7192e4c64aac116a03519d6b9` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:19.722827 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d087aec7192e4c64aac116a03519d6b9)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:19.724100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:20.153996 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd087aec7192e4c64aac116a03519d6b9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.277459 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd087aec7192e4c64aac116a03519d6b9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.290340 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd087aec7192e4c64aac116a03519d6b9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.291003 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd087aec7192e4c64aac116a03519d6b9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.297888 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd087aec7192e4c64aac116a03519d6b9'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.303819 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1458/2894] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:19 2022] DELETE /identity/v3/users/d087aec7192e4c64aac116a03519d6b9 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:20.553396 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d47818-4c95-48e4-b99e-a12ddea28962 service cinder] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:20.565846 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d47818-4c95-48e4-b99e-a12ddea28962 service cinder] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:20.630956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:20.631819 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:20.632125 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:20.632409 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] PATH_INFO: `/v3/projects/9b761cebe8334092a4ffa6e9549555c9` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:20.634112 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b761cebe8334092a4ffa6e9549555c9)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:20.636019 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:20.781992 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b761cebe8334092a4ffa6e9549555c9', 'request_id': 'req-6cc116ad-2ad2-465d-b462-2ea0e3627bee'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.788455 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b761cebe8334092a4ffa6e9549555c9', 'request_id': 'req-6cc116ad-2ad2-465d-b462-2ea0e3627bee'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.906900 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b761cebe8334092a4ffa6e9549555c9', 'request_id': 'req-6cc116ad-2ad2-465d-b462-2ea0e3627bee'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.918512 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] The token cache is being invalidate because project 9b761cebe8334092a4ffa6e9549555c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:20.918804 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.919526 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:20.921294 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1437/2895] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:20 2022] DELETE /identity/v3/projects/9b761cebe8334092a4ffa6e9549555c9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:20.925408 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:20.926815 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:20.940082 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df185fa-9e42-4397-8aff-2d1dd0908605 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:20.998845 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:20.999731 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:21.000054 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:21.000337 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] PATH_INFO: `/v3/users/6ea3beae629541698846713966404da1` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:21.001626 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea3beae629541698846713966404da1)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:21.003563 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:21.025576 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:21.251262 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea3beae629541698846713966404da1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.386185 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea3beae629541698846713966404da1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.398764 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea3beae629541698846713966404da1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.399440 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea3beae629541698846713966404da1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.406350 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-7707077d-f773-494a-ba35-dbbdafcd1abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea3beae629541698846713966404da1'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.412398 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1459/2896] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:20 2022] DELETE /identity/v3/users/6ea3beae629541698846713966404da1 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:41:21.690909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:21.692540 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:21.707501 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc116ad-2ad2-465d-b462-2ea0e3627bee admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:21.765059 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:21.765882 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:21.766168 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:21.766446 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] PATH_INFO: `/v3/projects/a43462f339504a52920db1d6ee190b92` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:21.767662 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43462f339504a52920db1d6ee190b92)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:21.769611 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:21.977017 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:21.988752 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43462f339504a52920db1d6ee190b92', 'request_id': 'req-7979e7e4-0469-49d4-90a7-ad0615081b6e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:21.994958 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43462f339504a52920db1d6ee190b92', 'request_id': 'req-7979e7e4-0469-49d4-90a7-ad0615081b6e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.128999 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43462f339504a52920db1d6ee190b92', 'request_id': 'req-7979e7e4-0469-49d4-90a7-ad0615081b6e'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.140205 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] The token cache is being invalidate because project a43462f339504a52920db1d6ee190b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:22.140497 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.141110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-7979e7e4-0469-49d4-90a7-ad0615081b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:22.142643 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1438/2897] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:21 2022] DELETE /identity/v3/projects/a43462f339504a52920db1d6ee190b92 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:22.147588 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8929-9821-430f-b3a2-7c1856ea1bbf None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.148099 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8929-9821-430f-b3a2-7c1856ea1bbf None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.148230 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8929-9821-430f-b3a2-7c1856ea1bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.166027 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-24cd8929-9821-430f-b3a2-7c1856ea1bbf None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:22.167270 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-24cd8929-9821-430f-b3a2-7c1856ea1bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:22.227153 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1460/2898] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:22.234947 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1d0c9-e0d1-47fb-81a4-f77d432d6f21 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.235242 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1d0c9-e0d1-47fb-81a4-f77d432d6f21 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.235525 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1d0c9-e0d1-47fb-81a4-f77d432d6f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.253770 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-1df1d0c9-e0d1-47fb-81a4-f77d432d6f21 None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:22.254964 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-1df1d0c9-e0d1-47fb-81a4-f77d432d6f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:22.263518 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1439/2899] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:22.267788 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8929-9821-430f-b3a2-7c1856ea1bbf None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.277994 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8929-9821-430f-b3a2-7c1856ea1bbf None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.282600 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2695f49-228d-44ce-b06f-d5970770444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.283230 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2695f49-228d-44ce-b06f-d5970770444d admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.283514 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2695f49-228d-44ce-b06f-d5970770444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.283793 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2695f49-228d-44ce-b06f-d5970770444d admin admin] PATH_INFO: `/v3/domains` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.284554 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2695f49-228d-44ce-b06f-d5970770444d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:41:22.284857 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2695f49-228d-44ce-b06f-d5970770444d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.289929 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2695f49-228d-44ce-b06f-d5970770444d admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:22.298278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1461/2900] 10.222.0.46 () {58 vars in 1152 bytes} [Thu Jun 2 13:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:41:22.302568 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1d0c9-e0d1-47fb-81a4-f77d432d6f21 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.317387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1d0c9-e0d1-47fb-81a4-f77d432d6f21 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.323724 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa8269-70ae-413a-bd0a-f16bede4af15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.324108 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa8269-70ae-413a-bd0a-f16bede4af15 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.324419 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa8269-70ae-413a-bd0a-f16bede4af15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.324691 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa8269-70ae-413a-bd0a-f16bede4af15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.325414 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa8269-70ae-413a-bd0a-f16bede4af15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.327412 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa8269-70ae-413a-bd0a-f16bede4af15 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:22.639714 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1440/2901] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:22 2022] POST /identity/v3/projects => generated 373 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:22.643841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2695f49-228d-44ce-b06f-d5970770444d admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.654014 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2695f49-228d-44ce-b06f-d5970770444d admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.710171 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf89739-c6ed-475e-ac54-c26d0ee37f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.710843 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf89739-c6ed-475e-ac54-c26d0ee37f26 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.711124 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf89739-c6ed-475e-ac54-c26d0ee37f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.711541 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf89739-c6ed-475e-ac54-c26d0ee37f26 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.712267 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf89739-c6ed-475e-ac54-c26d0ee37f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.714277 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf89739-c6ed-475e-ac54-c26d0ee37f26 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:22.830488 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1462/2902] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:22 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:22.834495 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa8269-70ae-413a-bd0a-f16bede4af15 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.844678 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa8269-70ae-413a-bd0a-f16bede4af15 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.849161 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4adb0-7b81-4aa2-b9e4-f13e4017304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.849820 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4adb0-7b81-4aa2-b9e4-f13e4017304c admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.850124 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4adb0-7b81-4aa2-b9e4-f13e4017304c admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.850389 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4adb0-7b81-4aa2-b9e4-f13e4017304c admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.851110 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4adb0-7b81-4aa2-b9e4-f13e4017304c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.852758 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4adb0-7b81-4aa2-b9e4-f13e4017304c admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:22.863539 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1441/2903] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:22.867311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf89739-c6ed-475e-ac54-c26d0ee37f26 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.877979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf89739-c6ed-475e-ac54-c26d0ee37f26 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.882453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103c2e9-9418-42c5-a8a1-07360efdb18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.883112 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103c2e9-9418-42c5-a8a1-07360efdb18c admin admin] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.883400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103c2e9-9418-42c5-a8a1-07360efdb18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.883678 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103c2e9-9418-42c5-a8a1-07360efdb18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.884448 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103c2e9-9418-42c5-a8a1-07360efdb18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.886047 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103c2e9-9418-42c5-a8a1-07360efdb18c admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:22.896066 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1463/2904] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:22.900151 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4adb0-7b81-4aa2-b9e4-f13e4017304c admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.910248 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4adb0-7b81-4aa2-b9e4-f13e4017304c admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.914712 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cab1e-fe0c-4b86-806e-3c7be8407d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.915593 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cab1e-fe0c-4b86-806e-3c7be8407d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.915895 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cab1e-fe0c-4b86-806e-3c7be8407d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.916706 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cab1e-fe0c-4b86-806e-3c7be8407d03 admin admin] PATH_INFO: `/v3/projects/c1e4f44b726f4c73b91ec6c54a78bee4/users/edbfdda61b3442ffa40c6c9ab4e03970/roles/b35814b03f814680843c3aead86264f7` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.931611 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cab1e-fe0c-4b86-806e-3c7be8407d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e4f44b726f4c73b91ec6c54a78bee4, user_id=edbfdda61b3442ffa40c6c9ab4e03970, role_id=b35814b03f814680843c3aead86264f7)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.934901 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cab1e-fe0c-4b86-806e-3c7be8407d03 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.024393 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1442/2905] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:22 2022] PUT /identity/v3/projects/c1e4f44b726f4c73b91ec6c54a78bee4/users/edbfdda61b3442ffa40c6c9ab4e03970/roles/b35814b03f814680843c3aead86264f7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:23.035534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede613-cedd-4e40-b80b-a05d7d8a9621 None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.035894 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede613-cedd-4e40-b80b-a05d7d8a9621 None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.036195 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede613-cedd-4e40-b80b-a05d7d8a9621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.043410 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:23.063489 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-b1ede613-cedd-4e40-b80b-a05d7d8a9621 None None] MFA Rules not processed for user `edbfdda61b3442ffa40c6c9ab4e03970`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:23.064832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-b1ede613-cedd-4e40-b80b-a05d7d8a9621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:23.127832 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1464/2906] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:41:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:23.132529 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cab1e-fe0c-4b86-806e-3c7be8407d03 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.194042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cab1e-fe0c-4b86-806e-3c7be8407d03 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.199090 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b7a59-5972-42b7-92f1-f49c02169e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.199837 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b7a59-5972-42b7-92f1-f49c02169e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.200153 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b7a59-5972-42b7-92f1-f49c02169e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.200431 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b7a59-5972-42b7-92f1-f49c02169e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.201133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b7a59-5972-42b7-92f1-f49c02169e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.203099 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b7a59-5972-42b7-92f1-f49c02169e44 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.308042 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1443/2907] 10.222.0.46 () {60 vars in 1152 bytes} [Thu Jun 2 13:41:23 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:23.312276 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ede613-cedd-4e40-b80b-a05d7d8a9621 None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.323240 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ede613-cedd-4e40-b80b-a05d7d8a9621 None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.379146 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002ed18-d463-429c-9f8a-76635abed9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.380502 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002ed18-d463-429c-9f8a-76635abed9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.380784 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002ed18-d463-429c-9f8a-76635abed9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.381059 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002ed18-d463-429c-9f8a-76635abed9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.381771 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002ed18-d463-429c-9f8a-76635abed9d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.383808 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002ed18-d463-429c-9f8a-76635abed9d4 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.506202 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1465/2908] 10.222.0.46 () {60 vars in 1143 bytes} [Thu Jun 2 13:41:23 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:41:23.510138 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b7a59-5972-42b7-92f1-f49c02169e44 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.520827 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b7a59-5972-42b7-92f1-f49c02169e44 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.525384 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c368d46-2a40-4f32-a077-39859681e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.526092 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c368d46-2a40-4f32-a077-39859681e716 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.526378 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c368d46-2a40-4f32-a077-39859681e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.526660 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c368d46-2a40-4f32-a077-39859681e716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.527386 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c368d46-2a40-4f32-a077-39859681e716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.529727 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c368d46-2a40-4f32-a077-39859681e716 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.540413 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1444/2909] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:23.544461 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002ed18-d463-429c-9f8a-76635abed9d4 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.554278 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002ed18-d463-429c-9f8a-76635abed9d4 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.558969 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de82d2-d351-4cfe-90a2-e11b63fb9ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.559841 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de82d2-d351-4cfe-90a2-e11b63fb9ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.560154 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de82d2-d351-4cfe-90a2-e11b63fb9ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.560429 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de82d2-d351-4cfe-90a2-e11b63fb9ddd admin admin] PATH_INFO: `/v3/projects/0116df46c88e401ca8f2e2027c277173/users/aed80f9d712045a6980d00293e75c3e1/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.575508 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de82d2-d351-4cfe-90a2-e11b63fb9ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0116df46c88e401ca8f2e2027c277173, user_id=aed80f9d712045a6980d00293e75c3e1, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.578179 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de82d2-d351-4cfe-90a2-e11b63fb9ddd admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.705756 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1466/2910] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:23 2022] PUT /identity/v3/projects/0116df46c88e401ca8f2e2027c277173/users/aed80f9d712045a6980d00293e75c3e1/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:23.709734 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c368d46-2a40-4f32-a077-39859681e716 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.720353 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c368d46-2a40-4f32-a077-39859681e716 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.748875 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:23.775382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e45f37-307b-4eaa-98b2-7b9d42c85c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.776012 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e45f37-307b-4eaa-98b2-7b9d42c85c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.776297 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e45f37-307b-4eaa-98b2-7b9d42c85c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.776572 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e45f37-307b-4eaa-98b2-7b9d42c85c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.777293 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e45f37-307b-4eaa-98b2-7b9d42c85c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.778909 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e45f37-307b-4eaa-98b2-7b9d42c85c30 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.789247 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1445/2911] 10.222.0.46 () {58 vars in 1121 bytes} [Thu Jun 2 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:41:23.793650 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de82d2-d351-4cfe-90a2-e11b63fb9ddd admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.803976 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de82d2-d351-4cfe-90a2-e11b63fb9ddd admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:23.808698 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0dea0-d5f7-441d-b948-a95f8ca34455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:23.809578 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0dea0-d5f7-441d-b948-a95f8ca34455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.809860 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0dea0-d5f7-441d-b948-a95f8ca34455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.810134 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0dea0-d5f7-441d-b948-a95f8ca34455 admin admin] PATH_INFO: `/v3/projects/0116df46c88e401ca8f2e2027c277173/users/aed80f9d712045a6980d00293e75c3e1/roles/31c5600d1f984a04827cf0052fc61678` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.812156 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0dea0-d5f7-441d-b948-a95f8ca34455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0116df46c88e401ca8f2e2027c277173, user_id=aed80f9d712045a6980d00293e75c3e1, role_id=31c5600d1f984a04827cf0052fc61678)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:23.814787 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0dea0-d5f7-441d-b948-a95f8ca34455 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:23.826975 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1467/2912] 10.222.0.46 () {60 vars in 1482 bytes} [Thu Jun 2 13:41:23 2022] PUT /identity/v3/projects/0116df46c88e401ca8f2e2027c277173/users/aed80f9d712045a6980d00293e75c3e1/roles/31c5600d1f984a04827cf0052fc61678 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:23.837748 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeda0c-853b-436e-b1d5-307dfc1d7564 None None] REQUEST_METHOD: `POST` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:23.838219 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeda0c-853b-436e-b1d5-307dfc1d7564 None None] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:23.838322 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeda0c-853b-436e-b1d5-307dfc1d7564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:23.864961 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.auth.core [None req-dcaeda0c-853b-436e-b1d5-307dfc1d7564 None None] MFA Rules not processed for user `aed80f9d712045a6980d00293e75c3e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:23.866190 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-dcaeda0c-853b-436e-b1d5-307dfc1d7564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:23.932506 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1446/2913] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:41:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:23.944460 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0dea0-d5f7-441d-b948-a95f8ca34455 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:23.946283 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-97a0dea0-d5f7-441d-b948-a95f8ca34455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:23.998199 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:24.004536 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0dea0-d5f7-441d-b948-a95f8ca34455 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:24.008250 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d79a8-acd9-4989-b2da-8471990a0a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2bc11c0ef524d7ea5cb8704fbbfcbb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:24.008901 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d79a8-acd9-4989-b2da-8471990a0a07 service cinder] REQUEST_METHOD: `GET` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:24.009187 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d79a8-acd9-4989-b2da-8471990a0a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:24.009464 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d79a8-acd9-4989-b2da-8471990a0a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:24.065400 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d79a8-acd9-4989-b2da-8471990a0a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:24.066768 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d79a8-acd9-4989-b2da-8471990a0a07 service cinder] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:24.075691 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1468/2914] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:27.781122 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeda0c-853b-436e-b1d5-307dfc1d7564 None None] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:27.845496 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeda0c-853b-436e-b1d5-307dfc1d7564 None None] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:27.850052 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:27.850945 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:27.851229 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:27.851504 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] PATH_INFO: `/v3/users/edbfdda61b3442ffa40c6c9ab4e03970` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:27.852690 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbfdda61b3442ffa40c6c9ab4e03970)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:27.854652 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:28.102323 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbfdda61b3442ffa40c6c9ab4e03970'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:28.237571 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbfdda61b3442ffa40c6c9ab4e03970'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:28.239015 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:28.250226 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbfdda61b3442ffa40c6c9ab4e03970'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:28.251382 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbfdda61b3442ffa40c6c9ab4e03970'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:28.258081 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbfdda61b3442ffa40c6c9ab4e03970'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:28.264148 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1447/2915] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:27 2022] DELETE /identity/v3/users/edbfdda61b3442ffa40c6c9ab4e03970 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:28.269229 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e0940-adaa-49e8-b844-1c5c4ac3c3af None None] REQUEST_METHOD: `POST` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:28.269748 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e0940-adaa-49e8-b844-1c5c4ac3c3af None None] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:28.269863 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e0940-adaa-49e8-b844-1c5c4ac3c3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:28.286425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.auth.core [None req-4d7e0940-adaa-49e8-b844-1c5c4ac3c3af None None] MFA Rules not processed for user `ac80ec2c07774b5581b987e15cf3a2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:28.287616 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4d7e0940-adaa-49e8-b844-1c5c4ac3c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:28.345466 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1469/2916] 10.222.0.46 () {58 vars in 957 bytes} [Thu Jun 2 13:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:28.355070 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:28.356589 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:28.415133 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605f2a-30ee-4f5e-b09b-ee552fdb1c0e admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:28.418806 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d10cc2-fdbd-4589-8c66-2c4456ca8191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7551e9626541d49a1be9330094f42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:28.419447 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d10cc2-fdbd-4589-8c66-2c4456ca8191 service neutron] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:28.419731 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d10cc2-fdbd-4589-8c66-2c4456ca8191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:28.420053 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d10cc2-fdbd-4589-8c66-2c4456ca8191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:28.428838 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d10cc2-fdbd-4589-8c66-2c4456ca8191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:28.430475 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d10cc2-fdbd-4589-8c66-2c4456ca8191 service neutron] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:28.441508 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1448/2917] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:28.951566 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e0940-adaa-49e8-b844-1c5c4ac3c3af None None] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:28.953061 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-4d7e0940-adaa-49e8-b844-1c5c4ac3c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:28.965183 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e0940-adaa-49e8-b844-1c5c4ac3c3af None None] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:28.970720 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:28.971609 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:28.971899 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:28.972176 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] PATH_INFO: `/v3/projects/c1e4f44b726f4c73b91ec6c54a78bee4` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:28.973425 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e4f44b726f4c73b91ec6c54a78bee4)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:28.975344 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:29.139979 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e4f44b726f4c73b91ec6c54a78bee4', 'request_id': 'req-3c3c3388-b405-4477-b985-c08e1e417b94'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:29.146092 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e4f44b726f4c73b91ec6c54a78bee4', 'request_id': 'req-3c3c3388-b405-4477-b985-c08e1e417b94'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:29.300294 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e4f44b726f4c73b91ec6c54a78bee4', 'request_id': 'req-3c3c3388-b405-4477-b985-c08e1e417b94'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:29.311239 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] The token cache is being invalidate because project c1e4f44b726f4c73b91ec6c54a78bee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:29.311523 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:29.312210 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:29.313873 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1470/2918] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:28 2022] DELETE /identity/v3/projects/c1e4f44b726f4c73b91ec6c54a78bee4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:29.317912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d10cc2-fdbd-4589-8c66-2c4456ca8191 service neutron] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:29.327950 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d10cc2-fdbd-4589-8c66-2c4456ca8191 service neutron] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:29.383620 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:29.384623 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:29.384912 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:29.385193 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] PATH_INFO: `/v3/users/aed80f9d712045a6980d00293e75c3e1` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:29.386421 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed80f9d712045a6980d00293e75c3e1)` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:29.388486 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:29.662516 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed80f9d712045a6980d00293e75c3e1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:29.786175 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed80f9d712045a6980d00293e75c3e1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:29.798759 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed80f9d712045a6980d00293e75c3e1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:29.799387 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed80f9d712045a6980d00293e75c3e1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:29.803739 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:29.806676 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.notifications [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed80f9d712045a6980d00293e75c3e1'} {{(pid=80583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:29.812494 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1449/2919] 10.222.0.46 () {58 vars in 1223 bytes} [Thu Jun 2 13:41:29 2022] DELETE /identity/v3/users/aed80f9d712045a6980d00293e75c3e1 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:30.370100 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] Authenticating user token {{(pid=80584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:30.377453 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.fernet_utils [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:30.386829 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c3388-b405-4477-b985-c08e1e417b94 admin admin] Validating token access rules against request {{(pid=80584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:30.410534 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:30.446515 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac80ec2c07774b5581b987e15cf3a2d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4046aee9673645e2803f9186d9e29f17', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:30.447633 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:30.447938 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:30.448214 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] PATH_INFO: `/v3/projects/0116df46c88e401ca8f2e2027c277173` {{(pid=80584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:30.449378 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0116df46c88e401ca8f2e2027c277173)` {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:30.451311 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] RBAC: Authorization granted {{(pid=80584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:30.620432 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0116df46c88e401ca8f2e2027c277173', 'request_id': 'req-e472762e-fa8b-4c65-92bf-843cd7c9cd08'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:30.626621 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0116df46c88e401ca8f2e2027c277173', 'request_id': 'req-e472762e-fa8b-4c65-92bf-843cd7c9cd08'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:30.728746 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0116df46c88e401ca8f2e2027c277173', 'request_id': 'req-e472762e-fa8b-4c65-92bf-843cd7c9cd08'} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:30.740911 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] The token cache is being invalidate because project 0116df46c88e401ca8f2e2027c277173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:41:30.741191 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:30.741812 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG keystone.notifications [None req-e472762e-fa8b-4c65-92bf-843cd7c9cd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:41:30.743335 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: [pid: 80584|app: 0|req: 1471/2920] 10.222.0.46 () {58 vars in 1232 bytes} [Thu Jun 2 13:41:30 2022] DELETE /identity/v3/projects/0116df46c88e401ca8f2e2027c277173 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:41:40.403003 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=3 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:41.003482 dv-cinder-797608-26-iscsi devstack@keystone.service[80584]: DEBUG dbcounter [-] [80584] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:39.407233 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] Authenticating user token {{(pid=80583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:39.408741 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:39.547531 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e9456-2787-4921-9c9d-a5f13a5ac611 admin admin] Validating token access rules against request {{(pid=80583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:39.606098 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb77bc3-cc5d-4be0-a3f0-99e2fa72a61f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0624612b2a4b1683a638b7ce4ca0f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ade2eaaff64b415f8aeafd96a4e7ada8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:39.606750 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb77bc3-cc5d-4be0-a3f0-99e2fa72a61f service placement] REQUEST_METHOD: `GET` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:39.607036 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb77bc3-cc5d-4be0-a3f0-99e2fa72a61f service placement] SCRIPT_NAME: `/identity` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:39.607317 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb77bc3-cc5d-4be0-a3f0-99e2fa72a61f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:39.609132 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.fernet_utils [None req-8eb77bc3-cc5d-4be0-a3f0-99e2fa72a61f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:39.621344 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb77bc3-cc5d-4be0-a3f0-99e2fa72a61f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:39.622956 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb77bc3-cc5d-4be0-a3f0-99e2fa72a61f service placement] RBAC: Authorization granted {{(pid=80583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:39.632965 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: [pid: 80583|app: 0|req: 1450/2921] 10.222.0.46 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:49.628569 dv-cinder-797608-26-iscsi devstack@keystone.service[80583]: DEBUG dbcounter [-] [80583] Writing DB stats keystone:SELECT=89 {{(pid=80583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}